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METHOD AND APPARATUS FOR SCREENING CHEMICAL COMPOUNDS 

This is a continuation-in-part of United States Application Serial No . 
09/300,355 filed April 27, 1999, which is a continuation-in-part of United States Patent 
Application Serial No. 09/042,527, filed March 16, 1998 and a continuation of pending 
5 International application PCT/US99/05589, filed March 16, 1999 in the United States PCT 
Receiving Office, all of which are incorporated by reference herein in their entirety. 

Field of the Invention 

The present invention relates to methods and apparatus for identifying 
pharmacological agents useful for the diagnosis and treatment of disease by performing a 
10 variety of assays on cell extracts, cells or tissues where the measurement of biological 

activity involves the use of various embodiments of a line-scan confocal imaging system and 
associated data processing routines. 

Background of the Invention 

There is currently a need in drug discovery and development and in general 

15 biological research for methods and apparatus for accurately performing cell-based assays. 
Cell-based assays are advantageously employed for assessing the biological activity of 
chemical compounds and the mechanism-of-action of new biological targets. In a cell-based 
assay, the activity of interest is measured in the presence of both competing and 
complementary processes. As pertains to chemical compound screening, information is 

20 available as to the specific activity of the compound. For example, it is possible to assess not 
only whether a compound binds the target of the assay, but also whether it is an agonist or 
an antagonist of the normal activity of the target. Frequently, the target is a cell-surface 
receptor. In some signaling pathways, the member of the pathway of greatest potential 
therapeutic value is not the receptor but an intracellular signaling protein associated with the 

25 receptor. It is, therefore, desirable to develop methods to assay activity throughout the 
pathway, preferably in the cellular milieu. 

In addition, there is a need to quickly and inexpensively screen large numbers 
of chemical compounds. This need has arisen in the pharmaceutical industry where it is 
common to test chemical compounds for activity against a variety of biochemical targets, for 

30 example, receptors, enzymes and nucleic acids. These chemical compounds are collected in 
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large libraries, sometimes exceeding one million distinct compounds. The use of the term 
chemical compound is intended to be interpreted broadly so as to include, but not be limited 
to, simple organic and inorganic molecules, proteins, peptides, nucleic acids and 
oligonucleotides, carbohydrates, lipids, or any chemical structure of biological interest, 

5 In the field of compound screening, cell-based assays are run on collections of 

cells. The measured response is usually an average over the cell population. For example, a 
popular instrument used for ion channel assays is disclosed in U.S. Patent No. 5,355,215. A 
typical assay consists of measuring the time-dependence of the fluorescence of an ion- 
sensitive dye, the fluorescence being a measure of the intra-cellular concentration of the ion 

10 of interest which changes as a consequence of the addition of a chemical compound. The 
dye is loaded into the population of cells disposed on the bottom of the well of a multiwell 
plate at a time prior to the measurement. In general, the response of the cells is 
heterogeneous in both magnitude and time. This variability may obscure or prevent the 
observation of biological activity important to compound screening. The heterogeneity may 

1 5 arise from experimental sources, but more importantly, heterogeneity is fundamental in any 
population of cells. Among others, the origin of the variability may be a consequence of the 
life-cycle divergence among the population, or the result of the evolutionary divergence of 
the number of active target molecules. A method that mitigates, compensates for, or even 
utilizes the variations would enhance the value of cell-based assays in the characterization of 

20 the pharmacological activity of chemical compounds. 

Quantification of the response of individual cells circumvents the problems 
posed by the non-uniformity of that response of a population of cells. Consider the case 
where a minor fraction of the population responds to the stimulus. A device that measures 
the average response will have less sensitivity than one determining individual cellular 

25 response. The latter method generates a statistical characterization of the response profile 
permitting one to select the subset of active cells. Additional characterization of the 
population will enhance the interpretation of the response profile. 

Various measurement devices have been used in the prior art in an attempt to 
address this need. Flow-cytometer-based assays are widely practiced and measure cell 

30 properties one at a time by passing cells through a focused laser beam. Several 

disadvantages accompany this method. Most important to the pharmaceutical industry is 
that assays can not readily be performed on compounds disposed in microtiter plates. In 
addition, the throughput is poor, typically 10-100 seconds per sample, the observation time 
of each cell is <1 ms, prohibiting kinetic assays, and finally, only the cell-averaged signal can 

35 be determined. 



-2- 



WO 02/35474 



PCT/US00/29776 



In addition, many assays require determination of the relative locations of the 
fluorescence signals. Devices called scanning cytometers, as disclosed in U.S. Patent No. 
5,107,422 and U.S. Patent No. 5,547,849, are widely used for imaging single cells. In order 
to gain acceptable speed, these devices operate at low (~5-I0^m) resolution. Thus, these 

5 devices offer little advantage over flow cytometers for assays requiring spatial information 
on the distribution of the fluorescence signals. 

An additional alternative technology is the fast-camera, full-field microscope. 
These devices have the ability to obtain images at a resolution and speed comparable to the 
present invention, on certain samples. However, they are not confocal and are consequently 

1 0 susceptible to fluorescence background and cannot be used to optically section the sample. 
In addition, simultaneous, multi-parameter data is not readily obtained. 

In contrast to the prior art, the present invention can be used to perform 
multi-parameter fluorescence imaging on single cells and cell populations in a manner that is 
sufficiently rapid and versatile for use in compound screening. Methods and apparatus are 

1 5 provided for obtaining and analyzing both the primary response of individual cells and 

additional measures of the heterogeneity of the sample population. In addition, the locations 
of these multiple fluorophores can be determined with sub-cellular resolution. Finally, the 
present invention can be used to image rapidly changing events at video-rates. Together 
these capabilities enable new areas of research into the mechanism-of-action of drug 

20 candidates. 

The present invention may also be employed in an inventive fluorescence- 
based biochemical assay, somewhat analogous to the surface scintillation assay ("SSA") 
which is among the more widely used methods for screening chemical compounds. 

Figs. 1(a)- 1(f) depict the steps of a receptor-binding SSA. In Fig. 1(a), 

25 soluble membranes 10 with chosen receptors 12 are added to a well 20 containing a liquid 
30. These membranes are isolated from cells expressing the receptors. In Fig. 1(b), radio- 
labeled ligands 14 are added to the well. The ligand is known to have a high binding affinity 
for the membrane receptors. The most common radio labels are 3 H, 35 S, 125 1, 33 P and 32 P. In 
Fig. 1(c), beads 16 are added to the well. The beads are coated with a material, such as 

30 wheat germ agglutinin, to which the membranes strongly adhere. The beads have a diameter 
of 3-8 um and are made of plastic doped with a scintillant. Alternatively, the order of the 
operations depicted in Figs. 1(b) and 1(c) may be interchanged. 

The radiolabels decay by emitting high energy electrons, or beta particles, 
which travel approximately 1-100 um before stopping, depending on the radio-isotope. If 

35 the radiolabels are bound to the membranes attached to the beads, the beta particles may 



WO 02/35474 



PCT/US00/29776 



travel into the beads and cause bursts of luminescence. If the radio-labels are dispersed 
throughout the liquid, the emitted beta particles will not generally excite luminescence in the 
beads. In Fig. 1(d), the luminescence of the beads caused by decay of the radio labels is 
detected" In Fig. 1(e), a test compound 18 is added to the well. The purpose of the assay is 

5 to determine the extent to which this compound will displace the radio-labeled ligands. If 
radio-labeled ligands are displaced and diffuse into the liquid, the luminescence of the beads 
will be reduced. In Fig. 1(f), the luminescence of the beads is again detected. By measuring 
the reduction in luminescence, the activity of the test compound can be determined. 

Figs. 2(a) - 2(f) depict an alternative embodiment of a receptor-binding SSA. 

10 This embodiment is essentially the same as that described in Figs. 1(a) - 1(f) except that 
instead of using beads, the embodiment shown in Figs. 2(a) - 2(f) uses a well bottom 22 
made of plastic doped with scintillant and coated with a material to which the membranes 
adhere. Consequently, instead of detecting the luminescence of the beads, the embodiment 
shown in Figs. 2(a) - 2(f) detects the luminescence of the well bottom. 

15 Figs. 3(a) - 3(d) depict the steps of an embodiment of an enzyme SSA. In • 

Fig. 3(a), scintillant-doped beads 40 with radio-labeled peptides 42 attached thereto are 
added to a well 50 containing a liquid 60. In Fig. 3(b), a test compound 44 is added to the 
well. In Fig. 3(c), enzymes 46 are added to the well. If not inhibited, enzymes 46 will cleave 
radio-labeled peptides 42 from beads 40. As a result, the radio label will diffuse into the 

20 solution, and radio-label decay will not produce luminescence in beads 40. If, on the other 
hand, test compound 44 inhibits enzymes 46, typically by blocking the enzyme active site, 
enzymes 46 will not cleave the radio label and the decay of the radio label will produce 
luminescence in the beads. In Fig. 3(d), the luminescence of the beads is measured and the 
activity of the test compound can be determined. 

25 Figs. 4(a) - 4(d) depict an alternative embodiment of an enzyme SSA. In Fig. 

4(a), radio-labeled peptides 42 are attached to a scintillant-doped well bottom 52. In Fig. 
4(b), the test compound 44 is added to the well. In Fig. 4(c), enzymes 46 are added to the 
well. In Fig. 4(d), the luminescence of the well bottom is measured to determine the activity 
of the test compound. 

30 The above examples illustrate the general principle of the SSA, namely that 

the activity of interest is assayed by a change in the number of radio labels within a radio- 
decay length of the scintillant. One of the attractions of SSAs is that the radio labels not 
attached to the scintillant need not be removed from the well in a wash step. That is SSAs 
are homogeneous assays. 
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A radioimmunoassay (RIA) is a specific form of a receptor binding assay in 
which the receptor is an antibody and the ligand is most often a natural or synthetic peptide, 
protein, carboydrate or small organic molecule. RIAs are an indirect method for measuring 
the concentration of ligand in any prepared sample, most often a biological sample such as 

5 plasma, cerebrospinal fluid, urine, or cellular extract. In a standard RIA the antibody has a 
specific affinity for the ligand and the assay contains the antibody, a fixed concentration of 
radiolabeled ligand and an unknown concentration of non-labelled ligand. The concentration 
of the unlabelled ligand is determined by the degree to which it binds to the antibody and 
thereby blocks binding of the labelled ligand. RIAs are most often performed as 

10 heterogenous assays that require the separation of bound ligand from unbound ligand with a 
wash step. RIAs have also been developed using an SSA configuration in which the 
antibody receptor is attached to a scintillant filled bead and the wash step is eliminated. 

SSAs and RIAs, however, suffer from a number of disadvantages. First, 
these assays require handling radioactive material, which is both expensive and time 

15 consuming. Second, these assays are only effective in large wells. The rate of luminescence 
emission from the beads or well bottoms is proportional to the beta particle emission rate. A 
typical 3 H assay yields less than one detected photon per 3 H decay. To increase the speed of 
the assay, the quantity of radio-labeled ligand must be increased, and correspondingly the 
quantities of membranes, beads and test compound. In order to perform a tritium SSA in 

20 10-60 seconds, 10 7 beads must be used. This quantity of beads requires a well of 

approximately 1 50 uL. SSAs are not effective in the uL-volume wells desirable for screening 
large numbers of compounds. 

As described below, the present invention, inter alia, replaces the radio- 
labeled ligands of the SSA and the RIA with fluorescent-labeled ligands. In so doing, it 

25 introduces a homogenous format for the RIA and it advantageously retains the 

homogeneous format of the SSA. This is particularly important in uL-volume wells, for 
which surface tension renders washing impractical. However, in a homogeneous format, 
fluorescence can be a problem as can be illustrated with the receptor-binding assay. When 
the test compound is added, some fluorescent-labeled ligands are displaced and diffuse freely 

30 throughout the volume of the well, while others remain attached to the membranes. It is the 
fluorescence of the fluorescent-labeled ligands attached to the membranes that is used to 
determine the activity of the test compound. If the fluorescence is detected from the entire 
well, however, the emission from the fluorescent -labeled ligands in the volume of the well 
will obscure the emission from the fluorescent-labeled ligands attached to the membranes. 
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One method addressing this problem is described in U.S. Patent No. 
5,355,215 to Schroeder et al. and shown in Figs. 5(a) and 5(b). According to the Schroeder 
et al. method, the samples are illuminated by a beam 134 of light that is directed at the 
bottom of the well at an oblique angle, shown as A in Fig. 5, so that it does not illuminate the 
5 entire well. In addition, while the beam illuminates area 1 14', fluorescence is detected only 
from area 1 14a which is under the well volume which receives the least amount of 
illumination. 

The Schroeder et al. method, however, suffers from a number of 
disadvantages. First, because it detects only a small portion of the well bottom, the 

1 0 Schroeder et al. method can only be performed with a sufficient degree of accuracy on fairly 
large wells. It is not suitable to image samples disposed in the approximately 1-mm diameter 
wells of a 1 536-well plate. Second, the geometric constraints of the angled illumination 
preclude the use of high numerical aperture collection optics, necessary to achieve sufficient 
sensitivity and resolution to image micron-sized objects, such as individual cells, at the 

15 bottom of the well. 

Another approach to this problem uses a point-scan microscope. For 
example, in U.S. Patent No. 5,547,849 to Baer et al., the use of a point-scan confocal system 
is taught. Baer et al. teach a method to increase the slow speed of image acquisition, 
inherent in point-scan confocal techniques, by sacrificing spatial resolution. If, for example, 

20 one expands the diameter of the illumination beam on the sample by a factor of 10, then the 
illumination area is increased 100-fold, permitting one to scan 100-times faster, under certain 
conditions. The speed increase is achieved, however, at the expense of resolution. Further, 
the detection devices appropriate to said scanning method, as disclosed in the ' 849 patent, 
are inferior, principally in terms of sensitivity, to those advantageously used in the present 

25 invention. Finally, the degree of background rejection is diminished along with the 
resolution. Thus the device disclosed in the '849 patent has lesser sensitivity, higher 
background and lower resolution than the present invention, all of which are important in the 
present application. 

The present invention includes novel embodiments of a line-scan confocal 

30 microscope. Line-scan confocal microscopes are known in art. Two representative 

embodiments are the system disclosed by White et al. in U.S. Patent No. 5,452,125 and that 
published by Brakenhoff and Visscher in J. Microscopy 111 17-26 (1993), shown in Fig. 7. 
Both use a scanning mirror to sweep the illumination across the sample. The same mirror 
de-scans the fluorescence radiation. After spatial filtering with a slit, the fluorescence is 

3 5 rescanned for viewing by eye. The use of the oscillating mirror enables these microscopes to 
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rapidly scan a field-of-view. Line illumination is advantageous principally in applications 
requiring rapid imaging. The potential speed increase inherent in the parallelism of line 
illumination as compared to point illumination is, however, only realized if the imaging 
system is capable of detecting the light emitted from each point of the sample along the 
5 illumination line, simultaneously. An essential feature of the disclosed apparatus is the use of 
a detection device having manifold, independent detection elements in a plane conjugate to 
the object plane. 

According to the present invention, the sample must lie in a "plane", where 
the depth-of-field of the imaging system determines the precision of "planarity". In a 

10 preferred embodiment, the imaged area is 1 mm 2 and the depth- of-field is 10 um. Thus, if 
the entire field is to be in focus simultaneously, the sample must be flat to 1 part in 100. This 
is true of many sample substrates (e.g. microtiter plates) over a local area (such as the central 
area of the well bottom). It is not practical, however, to require that the sample substrate be 
flat over its entire surface. For a microtiter plate having an extent of -100 mm, planarity of 

1 5 1 part in 10,000 would be necessary. 

The present invention provides for an optical autofocus system which 
maintains in "focus" the portion of the sample substrate being imaged. An optical autofocus 
mechanism has the advantage of being fast and being operational with non-conducting 
substrates such as plastic microtiter plates and microscope slides. Advantageously, this 

20 focus mechanism operates with negligible delay, that is, the response time of the focusing 
mechanism is short relative to the image acquisition-time, preferably a fraction of a second. 
Optically-based autofocus mechanisms suitable for the present application are known. For 
example, an astigmatic-lens-based system for the generation of a position error signal 
suitable for servo control is disclosed in Applied Optics 23 565-570 (1984), and a focus 

25 error detection system utilizing a "skew beam" is disclosed in SPIE 200 73-78 (1979). In a 
preferred embodiment of the present invention, the sample substrate is a microtiter plate. In 
this case, the preferred means of accomplishing the focusing depends further on the 
properties of the plate. If the thickness of the plate bottom were uniform to within a fraction 
of the depth-of-focus, then a focusing mechanism that maintained the plate bottom at a 

30 constant offset from the object plane would be adequate. Presently, commonly used 

microtiter plates are not sufficiently uniform. Thus, the focusing mechanism must track the 
surface on which the sample resides, which is typically the inside of the microtiter plate well. 
An aspect of the present invention is a novel autofocus mechanism for rapidly focusing on a 
discontinuous surface, such as the well bottom of a microtiter plate. 
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There is, therefore, a need for a method and apparatus for screening large 
numbers of chemical compounds accurately, quickly and inexpensively, in a homogeneous 
format. In addition, there is a need for a methods and apparatus that can perform multi- 
parameter fluorescence imaging with sufficient resolution to image individual cells and sub- 
5 cellular events. There is also a need for an imaging system that can additionally monitor a 
statistically significant population of cells at video-rates. 

Summary of the Invention 

The present invention relates to a line-scan confocal microscope and the use 
10 of a line-scan confocal imaging (LCI) system to assay biological activity. 

In a preferred embodiment, the line-scan confocal imaging system employs 
laser light sources of multiple wavelengths for illuminating the sample and exciting 
fluorophores to emit electromagnetic energy. These wavelengths include the ultraviolet 
spectrum as well as the visible. 
1 5 The present invention is able to conduct a rapid series of assays on micro-well 

plates by use of an autofocus capability which allows the LCI system to rapidly move from 
one well to another but not lose the advantage of the confocal microscope's inherent ability 
to resolve thin optical sections. 

In various embodiments of the present invention the sample is moved to effect 
20 a scan of the line of illumination over the sample. In other embodiments, an oscillating 
mirror is used to produce a rapidly moving line of illumination effecting a scan of a sample 
which remains at a fixed position. By way of example, images can be obtained at a rate of up 
to 50 frames per second. 

The present invention preferably provides for integrated dispensing allowing 
25 the addition of substances to initiate rapidly changing biological events, such as the 
propagation of an action potential in nerve or muscle cells. 

The present invention preferably makes use of a multi-element solid state 
detection device such as a charged coupled device (CCD). This device is preferably read 
continuously. In a preferred embodiment, the present invention uses a rectangular CCD 
30 which avoids the need for a full two dimensional detector and allows higher read speeds. In 
addition, a larger effective field-of-view is achievable in the stage- scanning embodiment. 

The present invention also provides in a preferred embodiment, a capability to 
conduct specialized data analysis simultaneously with data acquisition to allow it to operate 
in a high-throughput screening mode. 
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This invention provides methods of performing a wide variety of biological 
assays utilizing fluorescence. In one embodiment the target of interest may be in a fixed or 
live cell or in a subcellular organelle or on the cell membrane. These assays involve the 
determination of one or more parameters which requires the excitation of one or more 

5 fluorescent labels which are, in general, sensitive to different wavelengths of incident light. 
In addition these assays require the simultaneous and precise imaging of the emitted light at 
one or more wavelengths from which the location in two or three dimensions and the 
intensity of the fluorescently labeled species and their correlations are determined. 

In addition, this invention provides methods to perform assays which require 

10 either a single imaging of a response, by means of fluorescent emission, or rapidly repeated 
imaging of the same area or cell. In various embodiments, imaging is performed at rates as 
high as 50 frames per second. This ability to image rapidly, in multiple wavelengths and with 
high spatial resolution allows the present invention to perform assays that could not 
previously be performed or to perform them in a superior manner. 

1 5 The present invention relates to several methods for screening chemical 

compounds and for performing many types of assays involving the use of fluorophores or 
fluorescent probes. In general these assays and screening procedures involve the use of a 
test compound and'reagents some or all of which are intrinsically fluorescent, tagged with 
fluorescent labels or are metabolized into fluorescent product. The test compound and the 

20 reagents may be combined in a variety of ways. 

In one embodiment, the reagents are added to a well containing a liquid. This 
may be a single well or one of many wells on a multiwell plate. The biological activity of 
interest is determined by the presence or absence of fluorophores disposed on the bottom of 
the well or on the surface of beads disposed on the bottom of the well as measured with a 

25 line-scan confocal microscope. This embodiment has in common with the SSA format the 
determination of activity from the localization of the detected species. In the case of the 
SSA, the localization is proximal to the scintillant. In the present method, the localization is 
to a region of the well, preferably the bottom. In the case of the SSA, sensitivity to the 
proximal species is determined by the decay length of the beta particles. In the present 

30 method, sensitivity to the localized fluorophore is determined by the optical-sectioning depth 
of the confocal microscope. 

In addition, the present invention can perform high throughput assays 
requiring scanning multiple samples in a rapid and automatic manner. These samples may be 
individual micro-wells and may involve wells containing a liquid and live or fixed cells or 
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components of cells. The present invention also provides environmental controls required to 
retain liquid samples or sustain live cells during the analysis. 

Brief Description of the Drawings 

5 These and other objects, features and advantages of the invention will be 

more readily apparent from the following detailed description in which: 
Figs. 1(a) - 1(f) illustrate a first receptor-binding SSA. 
Figs. 2(a) - 2(f) illustrate a second receptor-binding SSA. 
Figs. 3(a) - 3(d) illustrate a first enzyme SSA. 
10 Figs. 4(a) - 4(d) illustrate a second enzyme SSA. 

Fig. 5(a) and 5(b) are schematic views of a prior art apparatus for imaging 
samples disposed on the bottom of a well. 

Fig. 6 is a schematic view of a first embodiment of a line-scan confocal 
microscope used to image samples according to the present invention. 
1 5 Fig. 7 is a schematic view of a prior art microscope. . 

Figs. 8(a) and 8(b) are, respectively, a top view and a side view of the ray 
path of a multicolor embodiment of the present invention, without a scanning mirror. Fig. 
8(c) is a top view of the ray path of a single beam autofocus. 

Figs. 9(a) and 9(b) are, respectively, a top view and a side view of the ray 
20 path of the multicolor embodiment of the present invention with the scanning mirror. Fig. 
9(c) is a top view of the ray path of the single beam autofocus. 

Fig. 10 is a side view of the two beam autofocus system. 
Fig. 1 1 (a)- 1 1 (c) illustrates the rectangular CCD camera and readout register, 
Figs. 12(a) and 12(b) are cross-sectional views of ray paths formed by the 
25 line-scan confocal microscope in the present invention employing conventional dark-field 
imaging. 

Figs. 13(a) and 13(b) are cross-sectional views of ray paths formed by the 
line-scan confocal microscope in the present invention using inverse dark-field imaging. 

Fig. 1 4 is a cross-sectional view of ray paths formed by the line-scan confocal 
30 microscope in the present invention using inverse dark-field imaging, where an area larger 
than the diffraction-limited area of the sample plane is illuminated. 

Figs. 15(a) - 15(f) illustrate a first embodiment of a receptor-binding assay 
according to the present invention. 

Figs. 16(a) - 16(f) illustrates a second embodiment of a receptor-binding 
35 assay according to the present invention. 
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Figs, 17(a) - 17(d) illustrate a first embodiment of an enzyme assay according 
to the present invention. 

Figs 18(a) - 18(d) illustrate a second embodiment of an enzyme assay 
according to the present invention. 
5 Fig 19(a)-(p) shows neuroblastoma cell calcium response to Carbachol. The 

responses at preinjection time, 0, 1.2, 2,4, 3.6, 4.8, 6,0, 7.2, 8.4, 9.6, 10.8, 12.0, 13.2, 14.4, 
15.6 seconds are shown (i.e., Figs. 19(a)-(o), respectively). 

Figs. 20(a) - 20(h) shows neuroblastoma cell calcium response to 50 mM 
KC1. The responses at 0, 0.6, 3.0, 5.4, 7.8, 10.2, 12.6 and 1 5.0 seconds are shown (i.e., 
10 Figs. 20(a)-(h), respectively). 

Figs. 21(a) - 21 (c) shows homogeneous live cell receptor binding assay. Fig. 
21(a) shows cells stained with fluorescein labeled peptide ligand. Fig. 21(b) shows a mask- 
generated from cytoplasmic staining with LDS 751. Fig. 21(c) is an overlay of Figs. 21(a) 
and (b), which shows the variable receptor activity. 
1 5 Figs. 22(a) - 22(d) shows homogeneous live cell receptor binding assay. Fig. 

22(a) graphically depicts competitive binding of labeled and unlabeled ligand to a cell surface 
receptor. Figs. 22(b)-(d) shows images of immunofluorescence at indicated points on the 
graph. 

Figs, 23(a) - 23(d) shows homogeneous live cell receptor binding assay with 
20 Cy3 labeled ligand. 

Figs. 24(a) - 24(d) shows 4um diameter silica beads with varying numbers of 
Cy5 labels. Fig. 24(a) shows an image of beads that are not labeled. Figs. 24(b)-(d) show 
images of beads that average 17, 170 or 1700 Cy54abeled molecules per bead, respectively. 
The image shown in Fig. 24(d) is reduced in scale ten fold compared to the images in Figs. 
25 24(a)-(c). 

Figs. 25(a) - 25(c) shows the data from the ion channel assay as graphs. Fig. 
25(a) relates to the response of neuroblastoma cells to the addition of carbachol. Figs. 
25(b)-(c) relate to the calcium response of neuroblastoma cells to the addition of 50mM KG 

30 Detailed Description of the Invention 

All patent applications, publications, and other references that are listed 
herein are hereby incorporated by reference in their entireties 

The present invention if useful for identifying pharmacological agents for the 
treatment of disease It provides a high throughput method for conducting a wide variety of 
35 biological assays where one or more fluorescent reagents are employed to measure a 
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biological response. Such assays can be conducted on chemical compounds or any molecule 
of biological interest, included but not limited to drug candidates, such as those found in 
combinatorial libraries. In addition, this invention provides a method for the diagnosis of 
pathological states from cell and tissue samples. This invention also provides a method for 
5 profiling multiple biological responses of drug candidates on whole cells using fluorescent 
reagents. 

The techniques of the present invention may be used in assays in which data is 
acquired on individual cells, on a cellular or sub-cellular level, sufficiently rapidly so as to 
permit the acquisition of such data on a sufficient number of cells to constitute a statistically 
10 meaningful sample of the cell population. The present invention is able to make 

simultaneous measurements on multiple parameters and is also able to correlate multiple 
signals from individual cells. It may therefore be employed to assay heterogeneous cellular 
responses and to assay responses confined to a small subset of cells 

In addition, the present invention can image the simultaneous activation of 
1 5 multiple signal pathways and can correlate multiple signals simultaneously and over time. 
This capability is vital when the temporal response of individual cells or a comparison of the 
temporal response of individual cells is required for the specific assay. 

In addition, the present invention can image fluorescent signals from the 
confocal plane of cells in the presence of unbound fluorophore or in the presence of 
20 intrinsically fluorescent chemical compounds, including potential drug candidates. 

These assays may make use of any known fluorophore or fluorescent label 
including but not limited to fluorescein, rhodamine, Texas Red, Amersham Corp. stains Cy3, 
Cy5, Cy5.5 and Cy7, Hoechst's nuclear stains and Coumarin stains. (See Haugland R.P. 
Handbook of Fluorescent Probes and Research Chemicals 6"' Ed., 1996, Molecular Probes, 
25 Inc., Eugene, Oregon.) 

These assays include but are not limited to receptor-binding assays, assays of 
intra-cellular electric potential or pH, assays of ion concentrations, enzyme activity assays, 
trafficking assays, kinetic imaging assays and assays of rare cellular events. 

Receptor-binding and enzyme activity assays may be bead-based or cell-based 
30 assays. Some examples of bead-based assays are described in WO 98/55866. However, the 
method described therein makes use of point scan confocal technology and the present 
linescan confocal imaging system would have a significant advantage in terms of rate of data 
acquisition. 

35 
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OPTICAL CONFIGURATION 

Fig. 6 shows a first embodiment of the present invention. The microscope 
comprises a source 400 or 4 10 of electromagnetic radiation for example, in the optical range, 
350-750nm, a cylindrical lens 420, a first slit mask 430, a first relay lens 440, a dichroic 

5 mirror 450, an objective lens 470, a microtiter plate 480 containing a two-dimensional array 
of sample wells 482, a tube lens 490, a filter 500, a second slit mask 510 and a detector 520. 
These elements are arranged along optical axis OA with slit apertures 432, 512 in masks 
430, 510 extending perpendicular to the plane of Fig. 6. The focal lengths of lenses 440, 470 
and 490 and the spacings between these lenses as well as the spacings between mask 430 and 

1 0 lens 440, between objective lens 470 and microtiter plate 480 and between lens 490 and 
mask 510 are such as to provide a confocal microscope. In this embodiment, 
electromagnetic radiation from a lamp 400 or a laser 410 is focused to a line using a 
cylindrical lens 420. The shape of the line is optimized by a first slit mask 430. The slit 
mask 430 is depicted in an image plane of the optical system, that is in a plane conjugate to 

1 5 the object plane The illumination stripe formed by the aperture 432 in the slit mask 430 is 
relayed by lens 440, dichroic mirror 450 and objective lens 470 onto a microtiter plate 480 
which contains a two-dimensional array of sample wells 482. For convenience of illustration, 
the optical elements of Fig. 6 are depicted in cross-section and the well plate in perspective. 
The projection of the line of illumination onto well plate 480 is depicted by line 484 and is 

20 also understood to be perpendicular to the plane of Fig. 6. As indicated by arrows A and B, 
well plate 480 may be moved in two dimensions (X, Y) parallel to the dimensions of the 
array by means not shown. 

In an alternative embodiment, the slit mask 430 resides in a Fourier plane of 
the optical system, that is in a plane conjugate to the objective back focal plane (BFP) 460. 

25 In this case the aperture 432 lies in the plane of the figure, the lens 440 relays the 

illumination stripe formed by the aperture 432 onto the back focal plane 460 of the objective 
470 which transforms it into a line 484 in the object plane perpendicular to the plane of 
Fig 6. 

In an additional alternative embodiment the slit mask 430 is removed entirely. 
30 According to this embodiment, the illumination source is the laser 410, the light from which 
is focused into the back focal plane 460 of the objective 470 This can be accomplished by 
the combination of the cylindrical lens 420 and the spherical lens 440 as shown in Fig. 6, or 
the illumination can be focused directly into the plane 460 by the cylindrical lens 420. 
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An image of the sample area, for example a sample in a sample well 482, is 
obtained by projecting the line of illumination onto a plane within the sample, imaging the 
fluorescence emission therefrom onto a detector 520 and moving the plate 480 in a direction 
perpendicular to the line of illumination, synchronously with the reading of the detector 520. 
5 In the embodiment depicted in Fig. 6, the fluorescence emission is collected by the objective 
lens 470, projected through the dichroic beamsplitter 450, and imaged by lens 490 through 
filters 500 and a second slit mask 5 1 0 onto a detector 520, such as is appropriate to a 
confocal imaging system having an infinity-corrected objective lens 470. The dichroic 
beamsplitter 450 and filter 500 preferentially block light at the illumination wavelength. The 
1 0 detector 520 illustratively is a camera and may be either one dimensional or two dimensional. 
If a one dimensional detector is used, slit mask 510 is not needed. The illumination, 
detection and translation procedures are continued until the prescribed area has been imaged. 
Mechanical motion is simplified if the sample is translated at a continuous rate. Continuous 
motion is most useful if the camera read-time is small compared to the exposure-time. In a 
1 5 preferred embodiment, the camera is read continuously. The displacement d of the sample 
during the combined exposure-time and read-time may be greater than or less than the width 
of the illumination line W, exemplarily 0.5W ids 5W. All of the wells of a multiwell plate 
can be imaged in a similar manner. 

Alternatively, the microscope can be configured to focus a line of illumination 
20 across a number of adjacent wells, limited primarily by the field-of-view of the optical 
system. Finally, more than one microscope can be used simultaneously. 

The size and shape of the illumination stripe 484 is determined by the width 
and length of the Fourier transform stripe in the objective lens back focal plane 460. For 
example, the length of the line 484 is determined by the width of the line in 460 and 
25 conversely the width in 484 is determined by the length in 460. For diffraction-limited 
performance, the length of the illumination stripe at 460 is chosen to overfill the objective 
back aperture. It will be evident to one skilled in the art that the size and shape of the 
illumination stripe 484 can be controlled by the combination of the focal length of the 
cylindrical lens 420 and the beam size at 420, that is by the effective numerical aperture in 
30 each dimension, within the restrictions imposed by aberrations in the objective, and the 
objective field of view. 

The dimensions of the line of illumination 484 are chosen to optimize the 
signal to noise ratio. Consequently, they are sample dependent Depending on the assay, the 
resolution may be varied between diffraction-limited, i.e., less than 0.5 pm, and 
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approximately 5 p,m. The beam length is preferably determined by the objective field of 
view, exemplarily between .5 and 1.5 mm. A Nikon ELWD, 0.6 NA, 40X objective, for 
example, has a field of view of approximately 0.75 mm. The diffraction-limited resolution 
for 633 nm radiation with this objective is approximately 0.6 p.m or approximately 1 100 

5 resolution elements. 

The effective depth resolution is determined principally by the width of 
aperture 5 1 2 in slit mask 5 1 0 or the width of the one dimensional detector and the image 
magnification created by the combination of the objective lens 470 and lens 490. The best 
depth resolution of a confocal microscope approaches 1 p.m. In the present application, a 

1 0 depth resolution of 5- 1 0 u-m may be sufficient or even advantageous. 

For example, when the sample of interest, such as a live cell, contains 
insufficient fluorophores in a diffraction-limited volume to permit an adequate signal-to-noise 
image in a sufficiently brief image-acquisition time, it is advantageous to illuminate and 
collect the emission from a larger than diffraction-limited volume. A similar situation 

1 5 prevails in the case of video-rate kinetics studies of transient events such as ion-channel 
openings. Practically, this is accomplished by underfilling the back aperture of the objective 
lens, which is equivalent to increasing the diameter of the illumination aperture. The 
effective numerical aperture ("NA") of the illumination is less than the NA of the objective. 
The fluorescence emission is, however, collected with the full NA of the objective lens. The 

20 width of aperture 512 must be increased so as to detect emission from the larger illumination 
volume. At an aperture width a few times larger than the diffraction limit, geometrical optics 
provides an adequate approximation for the size of the detection- volume element: 
Lateral Width: a d = cL/M, 
Axial Width: z d ~ >2a d /tana, 

25 where M is the magnification, d d is the width of aperture 5 12 and a is the half-angle 
subtended by the objective 470. It is an important part of the present invention that the 
illumination aperture 432 or its equivalent in the embodiment having no aperture and the 
detection aperture 512 be independently controllable. 

30 MULTI-WAVELENGTH CONFIGURATION 

An embodiment enabling multi-wavelength fluorescence imaging is preferred 
for certain types of assays. It is generally advantageous and often necessary that two or 
more measurements be made simultaneously since one important parameter in a biological 
response is time. 

35 
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The number of independent wavelengths or colors will depend on the specific 
assay being performed. In one embodiment three illumination wavelengths are used. Figs. 
8(a) and 8(b) depict the ray paths in a three-color line-scan confocal imaging system, from a 
top view and a side view respectively. In general, the system comprises several sources S n of 

5 electromagnetic radiation, collimating lenses L,„ and mirrors M n for producing a collimated 
beam that is focused by cylindrical lines CL into an elongated beam at first spatial filter SF,, 
a confocal microscope between first spatial filter SF,, and second spatial filter SF, and an 
imaging lens IL, beamsplitters DM, and DM 2 and detectors D„ for separating and detecting 
the different wavelength components of fluorescent radiation from the sample. Spatial filters 

1 0 SF, and SF, and SF : preferably are slit masks. 

In particular, Fig. 8(a) depicts sources, S„ S, and Sj, for colors A.,, X 2 and X x 
and lenses L,, L 2 and L, that collimate the light from the respective sources. Lenses L„ L, 
and L 3i preferably are adjusted to compensate for any chromaticity of the other lenses in the 
system. Mirrors M,, M ; and M 3 are used to combine the illumination colors from sources S n . 

1 5 The mirrors M, and M, are partially transmitting, partially reflecting and preferentially 

dichroic. M 2 , for example, should preferentially transmit A 3 , and preferentially reflect A,, It is 
thus preferential that A 3 be greater than X 2 . 

Operation of the microscope in a confocal mode requires that the combined 
excitation beams from sources S n be focused to a "line", or an highly eccentric ellipse, in the 

20 object plane OP. As discussed in connection to Fig. 6 above, a variety of configurations may 
be used to accomplish this. In the embodiment depicted in Fig. 8, the combined illumination 
beams are focused by cylindrical lens CL into an elongated ellipse that is coincident with the 
slit in the spatial filter SF,. As drawn in Figs. 8a and 8b, the slit mask SF, resides in an image 
plane of the system, aligned perpendicular to the propagation of the illumination light and 

25 with its long axis in the plane of the page of Fig. 8a. The lenses TL and OL relay the 
illumination line from the plane containing SF, to the object plane OP A turning mirror, 
TM, is for convenience. In another embodiment, DM i is between TL and OL and CL 
focuses the illumination light directly into the BFP. Other embodiments will be evident to 
one skilled in the art. 

30 Referring to Fig. 8(b), the light emitted by the sample and collected by the 

objective lens, OL, is imaged by the tube lens, TL, onto the spatial filter, SF,. SF, is 
preferentially a slit aligned so as to extend perpendicular to the plane of the page Thus, the 
light passed by filter SF, is substantially a line of illumination. SF, may be placed in the 
primary image plane or any plane conjugate thereto. DM 3 is partially reflecting, partially 

35 transmitting and preferably "multichroic". Multi-wavelength "dichroic" mirrors, or 
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"multichroic" mirrors can be obtained that preferentially reflect certain wavelength bands and 
preferentially transmit others. 

51, will be defined to be the fluorescence emission excited by A, This will, in 
general, be a distribution of wavelengths somewhat longer than 1,. 51, and 51 3 are defined 

5 analogously. DM 3 preferentially reflects l n , and preferentially transmits 51 n , n=l, 2,3. The 
light transmitted by SF, is imaged onto the detection devices, which reside in planes 
conjugate to the primary image plane. In Fig 8(a), an image of the spatial filter SF;, is 
created by lens IL on all three detectors, D n . This embodiment is preferred in applications 
requiring near-perfect registry between the images generated by the respective detectors. In 

1 0 another embodiment, individual lenses IL n are associated with the detection devices, the lens 
pairs IL and IL„ serving to relay the image of the spatial filter SF 2 onto the respective 
detectors D n . The light is split among the detectors by mirrors DM, and DM,. The mirrors 
are partially transmitting, partially reflecting, and preferentially dichroic. DM, preferentially 
reflects 51, and preferentially transmits 51 2 and Sl 3 . The blocking filter, BF„ preferentially 

15 transmits 51, effectively blocking all other wavelengths present. DM, preferentially reflects 
81, and preferentially transmits 51 3 . The blocking filters, BF, and BF 3 , preferentially 
transmit 51, and 51 3 respectively, effectively blocking all other wavelengths present. 

SCANNING MIRROR CONFIGURATION 

20 In some embodiments of this invention, rapid data acquisition requires 

framing images at video rates. Video-rate imaging generally refers to 30 or 60 frames per 
second. In the present use, it is intended to connote frame rates with an order-of-magnitude 
of 30 Hz. In a preferred embodiment, video-rate imaging is achieved by illuminating along 
one dimension of the sample plane and scanning the illumination beam in the direction 

25 perpendicular thereto so as to effect a relative translation of the illumination and sample. 
The scanning stage is generally massive. Consequently, it cannot be moved sufficiently 
rapidly. 

Fig. 9 depicts an embodiment of the invention utilizing a scanning mirror, 
SM. The mirror is advantageously placed in a plane conjugate to the objective back focal 

30 plane (BFP) A rotation in the BFP (or a plane conjugate thereto) effects a translation in the 
object plane (OP) and its conjugate planes. The full scan range of SM need only be a few 
degrees for typical values of the focal lengths of the lenses RL, and RL, As shown in Fig. 9, 
this lens pair images the BFP onto the SM at a magnification of one, but a variety of 
magnifications can be advantageously used. The limiting factors to the image acquisition 

35 rate are the camera read-rate and the signal strength. In the imaging mode described above, 
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data can be acquired continuously at the camera read-rate, exemplarily 1 MHz. With a 
scanning mirror, it is preferable to acquire data uni-directionally The idealized scanning 
motion allowing one to acquire data continuously is the sawtooth. In practice, the 
combination of turn-around and return scan times will constitute -1/3-2/3 of the scan period. 

5 Assuming 50% dead-time, a mirror oscillation frequency of 50 Hz and a pixel acquisition 
rate of 1 MHz, - 10,000 pixels would be acquired per frame at 50 frames per second, which 
is sufficient to define and track individual objects, such as cells, from frame to frame. 10 4 
pixels per image is, however, 10 2 -times fewer than was generally considered above. 
Depending on the application, it is advantageous to acquire relatively smaller images at high 

10 resolution, e.g. 50-pm X 50-pm at 0.5-p.m X 0.5-u.m pixelation, or relatively larger images at 
lower resolution, e.g. 200-pm X 200-pm at 2-pm pixelation. 

AUTOFOCUS 

According to the present invention, the sample must lie in the object plane of 

1 5 an imaging system. Accordingly, the invention provides an autofocus mechanism that 
maintains the portion of the sample in the field-of-view of the imaging system within the 
object plane of that system. The precision of planarity is determined by the depth-of- field of 
the system. In a preferred embodiment, the depth-of-field is approximately 10 pm and the 
field-of-view is approximately 1 mm 2 . 

20 The disclosed autofocus system operates with negligible delay, that is, the 

response time is short relative to the image acquisition-time, exemplarily 0.01-0 1 s. In 
addition, the autofocus light source is independent of the illumination light sources and the 
sample properties. Among other advantages, this configuration permits the position of the 
sample carrier along the optical axis of the imaging system to be determined independent of 

25 the position of the object plane. 

One embodiment of a single-beam autofocus is provided in Figs. 8 and 9, 
where a separate light source, S 4 of wavelength A 4 , and detector D 4 are shown. The 
wavelength A 4 is necessarily distinct from the sample fluorescence, and preferentially a 
wavelength that cannot excite appreciable fluorescence in the sample. Thus, A. 4 is 

30 preferentially in the near infrared, exemplarily 800-1000 nm. The partially transmitting, 
partially reflecting mirror, DM 4 , is preferentially dichroic, reflecting A 4 and transmitting X n 
and 8A„, n= 1,2,3. Optically-based autofocus mechanisms suitable for the present application 
are known. For example, an astigmatic-lens-based system for the generation of a position 
error signal suitable for servo control is disclosed in Applied Optics 23 565-570 ( 1 984) A 

35 focus error detection system utilizing a "skew beam" is disclosed in SPIE 200 73-78 ( 1 979). 
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The latter approach is readily implemented according to Figs. 8 and 9, where D 4 is a split 
detector. 

For use with a microtiter plate having a sample residing on the well bottom, 
the servo loop must, however, be broken to move between wells This can result in 
5 substantial time delays because of the need to refocus each time the illumination is moved to 
another well. 

Continuous closed-loop control of the relative position of the sample plane 
and the object plane is provided in a preferred embodiment of the present invention, depicted 
in Fig 10. This system utilizes two independent beams of electromagnetic radiation. One, 

10 originating from S 5 , is focused on the continuous surface, exemplarily the bottom of a 
microtiter plate. The other, originating from S 4 , is focused on the discontinuous surface, 
exemplarily the well bottom of a microtiter plate. In one embodiment, the beams originating 
from S 4 and S 5 have wavelengths A 4 and A 5 , respectively. A 4 is collimated by L 4 , apertured 
by iris I 4 , and focused onto the discontinuous surface by the objective lens OL. A 5 is 

1 5 collimated by L 5> apertured by iris I 5 , and focused onto the continuous surface by the lens 
CFL in conjunction with the objective lens OL. The reflected light is focused onto the 
detectors D 4 and D 5 by the lenses IL 4 and IL 5 , respectively. The partially transmitting, 
partially reflecting mirror, DM 4 , is preferentially dichroic, reflecting A 4 and A 5 and 
transmitting A n and 8A n , n=l,2,3. The mirrors, M 4 , M 5 and M 6 , are partially transmitting, 

20 partially reflecting. In the case that A 4 and A 5 are distinct, M 6 is preferentially dichroic. 

According to the embodiment wherein the sample resides in a microtiter 
plate, A 4 is focused onto the well bottom. The object plane can be offset from the well 
bottom by a variable distance. This is accomplished by adjusting L 4 or alternatively by an 
offset adjustment in the servo control loop For convenience of description, it will be 

25 assumed that A 4 focuses in the object plane. 

The operation of the autofocus system is as follows. If the bottom of the 
sample well is not in the focal plane of objective lens OL, detector D 4 generates an error 
signal that is supplied through switch SW to the Z control. The Z control controls a motor 
(not shown) for moving the microtiter plate toward or away from the objective lens. 

30 Alternatively, the Z control could move the objective lens. If the bottom PB of the 

microtiter plate is not at the focal plane of the combination of the lens CFL and the objective 
lens OL, detector D 5 generates an error signal that is applied through switch SW to the Z 
control An XY control controls a motor (not shown") for moving the microtiter plate in the 
object plane OP of lens OL. 
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As indicated, the entire scan is under computer control. An exemplary scan 
follows: At the completion of an image in a particular well, the computer operates SW to 
switch control of the servo mechanism from the error signal generated by D 4 to that 
generated by D 5 ; the computer then directs the XY control to move the plate to the next 

5 well, after which the servo is switched back to D 4 . 

The "coarse" focusing mechanism utilizing the signal from the bottom of the 
plate is used to maintain the position of the sample plane to within the well-to-well variations 
in the thickness of the plate bottom, so that the range over which the "fine" mechanism is 
required to search is minimized. If, for example, the diameter of the iris I 5 is 2 mm and IL 5 is 

10 ] 00 mm, then the image size on the detector will be ~ 100 urn. Similarly, if the diameter of 
the iris I 4 is 0.5 mm and IL 4 is 100 mm, then the image size on the detector will be - 400 pm. 
The latter is chosen to be less sensitive so as to function as a "coarse" focus. 

As with the single-beam embodiment described above, the wavelengths X 4 and 
k 5 are necessarily distinct from the sample fluorescence, and preferentially wavelengths that 

15 cannot excite appreciable fluorescence in the sample. Thus, A 4 and A 5 are preferentially in the 
near infrared, such as 800- 1 000 nm. In addition, the two wavelengths are preferably distinct, 
for example A. 4 = 830 nm, k 5 = 980 nm. 

In an alternative embodiment of two-beam autofocus, A 4 = k 5 and the two 
beams may originate from the same source. Preferentially, the two beams are polarized 

20 perpendicular to one another and M 6 is a polarizing beamsplitter. 

Pseudo-closed loop control is provided in the preferred embodiment of 
single-beam autofocus which operates as follows. At the end of a scan the computer 
operates SW to switch control to a sample-and-hold device which maintains the Z control 
output at a constant level while the plate is moved on to the next well after which SW is 

25 switched back to D 4 

DETECTION DEVICES 

An essential feature of the disclosed apparatus is the use of a detection device 
having manifold, independent detection elements in a plane conjugate to the object plane. 
30 As discussed above, line illumination is advantageous principally in applications requiring 
rapid imaging. The potential speed increase inherent in the parallelism of line illumination as 
compared to point illumination is, however, only realized if the imaging system is capable of 
detecting the light emitted from each point of the sample along the illumination line, 
simultaneously 
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It is possible to place a charge-coupled device (CCD), or other camera, at the 
output of the prior art imaging systems described above (White et al., US 5,452,125 and 
Brakenhoff and Visscher, ,/. Microscopy 171 17-26 (1993)). The resulting apparatus has 
three significant disadvantages compared to the present invention. One is the requirement of 
5 rescanning the image onto the two-dimensional detector, which adds unnecessary complexity 
to the apparatus Another is the requirement of a full two-dimensional detector having 
sufficient quality over the 1 000 pixel x 1 000 pixel array that typically constitutes the camera 
The third disadvantage is the additional time required to read the full image from the two- 
dimensional device. 

1 0 The present invention is designed to avoid these disadvantages and optimize 

not only imaging speed, within the constraints of high-sensitivity and low-noise detection, 
but also throughput. One embodiment uses a continuous-read line-camera, and in a 
preferred embodiment a rectangular CCD is used as a line-camera Both embodiments have 
no dead-time between lines within an image or between images. An additional advantage of 

1 5 the present invention is that a larger effective field-of-view is achievable in the stage- 
scanning embodiment, discussed below. 

The properties required of the detection device can be further clarified by 
considering the following preferred embodiment. The resolution limit of the objective lens is 
< 1 p,m, typically -0.5 pm, and the detector comprises an array of -1000 independent 

20 elements. Resolution, field-of-view (FOV) and image acquisition-rate are not independent 
variables, necessitating compromise among these performance parameters. In general, the 
magnification of the optical system is set so as to image as large a FOV as possible without 
sacrificing resolution. For example, a - I mm field-of-view could be imaged onto a 1000- 
element array at 1-pm pixelation. If the detection elements are 20-p.m square, then the 

25 system magnification would be set to 20X. Note that this will not result in 1-um resolution. 
Pixelation is not equivalent to resolution. If, for example, the inherent resolution limit of the 
objective lens is 0.5 pm and each 0.5 u-m X 0.5 urn region in the object plane is mapped onto 
a pixel, the true resolution of the resulting digital image is not 0.5 u,m. To achieve true 0.5- 
um resolution, the pixelation would need to correspond to a region -0.2 u.m X 0.2 p.m in the 

30 object plane In one preferred embodiment, the magnification of the imaging system is set to 
achieve the true resolution of the optics. 

Presently, the highest detection efficiency, lowest noise detection devices 
having sufficient read-out speed for the present applications are CCD cameras In Figure 1 1 , 
a rectangular CCD camera is depicted having an m x n array of detector elements where m is 

35 substantially less than n The image of the fluorescence emission covers one row that is 
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preferably proximate to the read register. This minimizes transfer time and avoids 
accumulating spurious counts into the signal from the rows between the illuminated row and 
the read-register. 

In principle, one could set the magnification of the optical system so that the 

5 height of the image of the slit SF, on the CCD camera is one pixel, as depicted in Figure 1 1 . 
In practice, it is difficult to maintain perfect alignment between the illumination line and the 
camera row-axis, and even more difficult to maintain alignment among three cameras and the 
illumination in the multi-wavelength embodiment as exemplified in Figs. 8 and 9. By binning 
together a few of the detector elements, exemplarily two to five, in each column of the 

1 0 camera the alignment condition can be relaxed while suffering a minimal penalty in read- 
noise or read-time. 

An additional advantage of the preferred embodiment having one or more 
rectangular CCD cameras as detection devices in conjunction with a variable-width detection 
spatial filter, SF, in Figs. 8 and 9 and 510 in Fig. 6, each disposed in a plane conjugate to the 

1 5 object plane, is elucidated by the following. As discussed above, in one embodiment of the 
present invention the detection spatial filter is omitted and a line-camera is used as a 
combined detection spatial filter and detection device. But as was also discussed above, a 
variable-width detection spatial filter permits the optimization of the detection volume so as 
to optimize the sample-dependent signal-to-noise ratio. The following preferred embodiment 

20 retains the advantage of a line-camera, namely speed, and the flexibility of a variable 

detection volume. The magnification is set so as to image a diffraction-limited line of height 
h onto one row of the camera. The width of the detection spatial filter d is preferably 
variable h < d < lOh The detectors in the illuminated columns of the camera are binned, 
prior to reading, which is an operation that requires a negligible time compared to the 

25 exposure- and read-times. 

In one preferred embodiment, the cameras are Princeton Instruments 
NTE/CCD-1 340/1 00-EMD. The read-rate in a preferred embodiment is 1 MHz at a few 
electrons of read-noise. The pixel format is 1340x100, and the camera can be wired to shift 
the majority of the rows (80%) away from the region of interest, making the camera 

30 effectively 1340x20. 

In addition to the above mentioned advantage of a continuous read camera, 
namely the absence of dead-time between successive acquisitions, an additional advantage is 
that it permits the acquisition of rectangular images having a length limited only by the extent 
of the sample. The length is determined by the lesser of the camera width and the extent of 

35 the line illumination. In a preferred embodiment the sample is disposed on the bottom of a 
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well in a 96-well microtiter plate, the diameter of which is 7 mm. A strip 1 |imX 1 mm is 
illuminated and the radiation emitted from the illuminated area is imaged onto the detection 
device. The optical train is designed such that the field-of-view is - 1 mm 2 . According to the 
present invention, an image of the well-bottom can be generated at 1 -\im pixelation over a 1 
5 X 7-mm field. 

ENVIRONMENTAL CONTROL 

In an embodiment of the present invention, assays are performed on live cells. 
Live-cell assays frequently require a reasonable approximation to physiological conditions to 

1 0 run properly. Among the important parameters is temperature. It is desirable to incorporate 
a means to raise and lower the temperature, in particular, to maintain the temperature of the 
sample at 37C. In another embodiment, control over relative humidity, and/or C0 2 and/or 
0, is necessary to maintain the viability of live cells. In addition, controlling humidity to 
minimize evaporation is important for small sample volumes. 

1 5 Three embodiments providing a microtiter plate at an elevated temperature, 

preferably 37C, compatible with the LCI system follow. 

The imaging system preferably resides within a light-proof enclosure. In a 
first embodiment, the sample plate is maintained at the desired temperature by maintaining 
the entire interior of the enclosure at that temperature. At 37C, however, unless elevated 

20 humidity is purposefully maintained, evaporation cooling will reduce the sample volume 
limiting the assay duration. 

A second embodiment provides a heated cover for the microwell plate which 
allows the plate to move under the stationary cover. The cover has a single opening above 
the well aligned with the optical axis of the microscope. This opening permits dispensing 

25 into the active well while maintaining heating and limited circulation to the remainder of the 
plate. A space between the heated cover plate and microwell plate of approximately 0.5 mm 
allows free movement of the microwell plate and minimizes evaporation. As the contents of 
the interrogated well are exposed to ambient conditions though the dispenser opening for at 
most a few seconds, said contents suffer no significant temperature change during the 

30 measurement. 

In a third embodiment, a thin, heated sapphire window is used as a plate 
bottom enclosure A pattern of resistive heaters along the well separators maintain the 
window temperature at the desired level 

In additional embodiments, the three disclosed methods can be variously 

35 combined 
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INTEGRATED DISPENSER 

One embodiment of the video-rate configuration of the imaging system is 
further configured to initiate kinetic assays, in particular ion-channel assays, with a timed 
reagent dispense. Initiation of channel opening is accomplished by dispensing a solution into 
5 the micro well For example, voltage-gated channels can be opened by addition of a solution 
of KC 1 to depolarize the plasma membrane. The time-dependence of the channel opening 
and subsequent closing and the corresponding change in intracellular concentration is often 
sufficiently rapid to require video-rate imaging. The intrinsic speed of the imaging system is 
irrelevant, however, unless the channel response can be initiated rapidly. 
1 0 One embodiment of the present invention provides an integrated dispenser, 

For assays run in 96- or 384-well plates, addition volumes in this range 20-100 pL are 
desirable. A single head dispenser, as is appropriate, for example, to the addition of an 
agonist of ion-channel activity, is the IVEK Dispense 2000. Comparable units are available 
from CAVRO. More generally, it is desirable to be able to dispense a unique compound into 
1 5 each well. One embodiment provides a single head dispenser on a robotic motion device that 
shuttles the dispense head between the analysis station, the source plate containing the 
unique compounds and the tip cleansing station. The latter is a wash station for a fixed tip 
dispenser and a tip changing station for a disposable tip dispenser. This system provides the 
desired functionality relatively inexpensively, but it is low throughput, requiring 
20 approximately 30 seconds per compound aspiration-dispense-cleanse cycle. An alternative 
embodiment is provided by integrating a multi-head dispenser such as the Hamilton Microlab 
MPH-96 into the disclosed LCI system. The MPH-96 consists of 96 independent fixed tip 
dispensers mounted to a robotic motion device capable of executing the aspirate-dispense- 
wash cycle described above. 
25 In an additional preferred embodiment of the invention, employed in 

automated screening assays, the imaging system is integrated with plate-handling robots, 
such as the Zymark Twister. 

DARK FIELD CONFOCAL CONFIGURATION 

30 In the case that the desired lateral resolution is less than the diffraction limit, 

the background fluorescence due to the supernatant liquid can be decreased by an inventive 
application of the dark-field imaging technique Figs 12(a) and 12(b) depict the ray paths in 
conventional dark-field In Fig. 12(a), a sample 600 is illuminated by a hollow cone of light 
610 from an objective lens 620. This cone of light is created, for example, by placing an 

35 opaque bar 630 at lens 440 in Fig. 1 0(a). In Fig. 12(b). the fluorescent emission from sample 
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600 is then collected through the center of the objective lens 620. Because of the differing 
angles of illumination and collection, the only plane which is both illuminated and detected is 
the plane containing sample 600. 

Figs 13(a) and 13(b) depict the ray paths in inverted dark-field In Fig. 

5 13(a), a sample 700 is illuminated with abeam of light 710 that passes through the center of 
an objective lens 720. In Fig 13(b), fluorescent emissions are then collected only from 
around the outside of objective lens 720. Collection from around the outside of the objective 
may be achieved by placing, for example, an opaque bar 730 at lens 490 in Fig. 10(a). Like 
conventional dark-field, inverted dark-field involves illumination at one angle and collection 

10 at a different angle so that only the sample plane is both illuminated and detected. 

Fig. 14 depicts the focal region in the case described above where it is 
advantageous to illuminate a larger than diffraction-limited area of the sample plane. The 
illumination and collection rays are the same as those in the inverted dark-field geometry of 
Fig. 13. If a stop is placed in a plane conjugate to the objective back focal plane having a 

15 width matched to the illumination beam, the dark-field configuration is achieved. That this 
configuration confers a decrease in the out-of-plane fluorescence impinging on the detector 
can be understood from Fig. 14. The fluorescence from the shaded regions above and below 
the object plane is not passed by the stop. In point-scan confocal, fluorescence from these 
out-of-plane regions is rejected efficiently by the detection aperture. In line-scan confocal, 

20 the out-of-plane fluorescence from one lateral position along the line contributes to the 
background signal at other points along the line: this is the origin of the degradation in 
signal-to-background in line-scan relative to point-scan confocal. The inverse dark-field 
configuration of line-scan confocal recovers a significant fraction of the background rejection 
attributes of point-scan confocal while retaining the speed advantage of the line-scan 

25 configuration. 
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code for operation on the hardware platform of interest. In a presently preferred 
embodiment, the computer is a 32-bit processor such as the Pentium II. In this case, all data 
is accessed in 32-bit parcels. 

In general the acquisition and analysis of the data comprises a number of 

5 discrete steps First, the fluorescence is converted into one or more digital images in which 
the digital values are proportional to the intensity of the fluorescent radiation incident on 
each pixel of the detection device. Within this step a correction is made for the non-uniform 
response of the imaging system across the field of view wherein the background subtracted 
data are divided by a so-called flat-field file. Second, a binary bitmap is generated from one 

1 0 of the digital images in which all values meeting certain criteria are replaced by one, all 
values failing to meet the criteria are replaced by zero. In one embodiment, the criteria 
include a threshold value determined from the image itself. Third, the bitmap is searched for 
groups of contiguous value-one pixels. In one embodiment the groups are further tested 
against minimum- and/or maximum-size criteria. Fourth, for the qualified groups, the values 

1 5 of the corresponding pixels in the same image or in another image are summed and recorded, 
and the average and other statistical properties of the sums determined and recorded. 

Significant throughput gains in digital image processing can be achieved by selecting 
data representations and algorithms that exploit the hardware architectures and performance 
behaviors of modern computers. It is particularly desirable to minimize the time spent 

20 accessing main memory, to match the data fetching patterns for which high speed caches are 
optimized and to use the fastest instructions a given CPU makes available: usually those of 
the integer arithmetic and logic units (ALUs). This can be done by choosing the most 
compact data format that adequately encodes the relevant information, addressing the data 
sequentially whenever possible and selecting algorithms that lend themselves to parallel 

25 computation. 

Morphological and spatial measurements such as object shape, size, 
orientation, location, number and so on are well suited to these optimizations because such 
quantities depend only upon the positions of pixels in the image rather than the intensities of 
pixels Therefore, a one bit per pixel encoding is the preferred data storage format when 
30 studying these image features. For clarity, the term "image" is used to refer to formats having 
more than one bit per pixel and the term "bitmap" is used to refer to formats having a single 
bit per pixel. 

While bitmaps (which are one form of spatially defined data) can be used, per 
se, for the efficient extraction of morphological and spatial information, they also serve an 
35 equally valuable role in studying the luminosity and density characteristics of objects in the 

-26- 

SUBSTITUTE SHEET (RULE 26) 



WO 02/35474 



PCT/US00/29776 



images from which the bitmaps are derived. They do so by serving as masks for their 
corresponding images. However, there are more and less efficient means of applying masks. 
One technique involves using a mask to alter (write to) the pixels in the original image. The 
preferred method assigns read-only status to the original images. The ones and zeros in the 
5 mask merely indicate which pixels of the corresponding image should and should not be 
accessed. In a sense, the mask could be viewed as masking pixel storage addresses rather 
than pixel data. 

For example, suppose one wishes to derive the total intensity of a particular 
target object within an image that contains one or more other objects in addition to the target 

1 0 as well as background. The recommended procedure would be to create a bitmap from the 
image whose bits B(i,j) are in one-to-one correspondence with the pixels P(i j) of the image. 
Next, working exclusively within the bitmap, one would perform whatever bitmap operations 
are necessary to isolate the target, describing its location in both bitmap and image as the set 
of bits {B(i,j)). We term such sets of related bits "masks." Finally, to sum the intensities of 

1 5 the pixels belonging to the target, one reads and accumulates only those pixels in the original 
image corresponding to the {B(i,j)}. 

Before applying the bitmap manipulation techniques to be described here, it is 
necessary to transform the image obtained from the imaging device into the bitmap format. 
Because no object information is known a priori, it is necessary to scan each pixel in the 

20 image and apply some criteria to decide whether the corresponding bit in the bitmap should 
be set to a one or a zero. The specific criteria to be applied will depend upon the application. 
However, some performance considerations preferably apply: (1) the image should be 
scanned in sequential order, that is, pixels should be scanned and evaluated in the order in 
which they are stored in memory; (2) the fastest possible evaluation will comprise the fewest 

25 possible criteria - in particular, one can do no better than having a single threshold value 
against which each image pixel is compared; and (3) best performance is achieved if criteria 
are chosen such that each bit B(i,j) in the bitmap is derived solely from pixels P(i,j) of the 
image, and is not dependent in any way upon values previously calculated for other of the 
B(i,j). This last consideration is especially useful for implementing the transformation 

30 efficiently in a multiprocessing environment. The work can be cleanly segmented among 
multiple processors if the results of each are independent. 

In accordance with the present invention another technique may also be used. 
One purpose of this technique is to identify all bits {B(i,j)} in a bitmap that belong to a given 
object For clarity, assume that ones represent bits within objects and zeroes represent bits in 

35 the background The routine requires as input a seed point' a coordinate pair (i,j) (which is 
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one example of a spatial definition) identifying at least one bit (whose value is one) lying 
within the target object or on its boundary. This seed point may be found by trial and error 
by attempting to build an object for each bit having a value of one. On exit, the routine will 
have zeroed those bits within the input bitmap that belong to the object, without having 

5 affected any bits not belonging to the object. In addition, the routine may be made to 

calculate other subsidiary spatial information, such as the coordinates of a bounding box that 
just encloses the object found, a count of the bits within the object (its area), the centroid of 
the object or numerous other results that derive from the fact that each bit belonging to the 
object will have been examined by the basic algorithm. 

10 The sense of "belonging to" an object is defined recursively as follows: a 

given bit JB(ij) belongs to an object if it is a one and if any of its four nearest neighbors 
(those immediately above, below, left or right of the given bit) has previously been 
determined to belong to the object 

The algorithm uses a stack (LIFO) data structure, wherein each element 

15 stores the coordinates (ij) of a bit that has been determined to belong to the object. I.e., as 
successive object bits are located, their coordinates are pushed onto the stack. At the start of 
the routine, the stack is initialized to have exactly one element: the coordinates of the initial 
seed point. 

The other essential feature of the algorithm is a loop that runs until all 
20 elements of the stack have been popped off, leaving the stack completely empty. On each 
iteration of the loop, the following operations are performed: 

(1) The topmost element of the stack is popped off to retrieve the 
coordinates of bit B(i,j). 
25 (2) Each of the four nearest neighbors of bit B(i,j) is examined in turn: 

(a) If the neighbor bit is a zero, it is skipped. 

(b) If the bit is a one, it fulfills the requirements of an object 
bit, so the neighbor's coordinates are pushed onto the stack. 

(3) Execution returns to step (1) if the stack is nonempty. 

30 

As stated, the basic algorithm outlined here provides a simple framework to 
which can be added other very useful spatial calculations. For example, to count the bits in 
an object, one need only increment a counter variable each time an element is popped off the 
stack As another example, the coordinates of each element popped off the stack can be 

35 
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compared to a record of the maximum and minimum position values of the bits found so far. 
In this way, the linear extent of the object (bounding box) can be determined. 

After having operated on a bitmap with the above procedure, all the bits in 
the target object will have been set to zeroes. If the area, bounding box or other subsidiary 

5 result had been all that was required from the calculation, the algorithm would be done at 
this point. However, if a mask set {B(ij)} of object bits is required, then the following 
procedure is recommended. Before executing the object finding routine on an input bitmap 
(U), a copy of the input bitmap (V) should be set aside. After executing the routine on 
bitmap (U), it is exactly identical to bitmap (V) except that the target bits have been 

10 obliterated in (U). The following operation will create a new bitmap whose only contents are 
the desired {B(i,j)| of the target object: 

{B(i,j)} = U XOR V, where XOR is the logical exclusive OR operation. 

1 5 This may be applied to the entirety of the bitmaps (U) and (V), or for greater 

speed, may be applied only to those bits of (U) and (V) within the bounding box of the 

object, found by the method outlined above. 

Erosion is the process of excluding pixels from the boundaries of objects. The 

operation is widely used for purposes of separating adjacent or overlapping objects. The 
20 method described makes good use of many of the optimization principles mentioned above 

and lends itself very well to multiprocessing environments. 

As above, suppose that the bits belonging to an object in the bitmap are 

encoded as ones, while those bits that do not belong to an object are encoded as zeros. A 

given bit will be considered to be the boundary point of an object if the bit is itself a one and 
25 one or more of the four nearest-neighbor bits (those immediately above, below, left or right 

of the given bit) is a zero Such boundary bits should be set to zero by the erosion process. 

Bits within the interior of an object are themselves ones and are surrounded by four other 

ones. These bits should remain ones in the eroded bitmap. Any bits that are zero in the 

original bitmap should be zero in the eroded bitmap. 
30 Let the bits in the original bitmap be denoted B(ij) and the corresponding bits 

in the eroded bitmap be denoted b(i,j). The erosion rules just stated may be expressed as: 

b(ij) = BO- 1 j) AND B(ij) AND B(i+1 j) AND B(ij-l) AND B(ij+1). 
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Alternatively, an expression of the rules can be given in terms of bitmap rows. 
Let R(i) represent row i of the original bitmap, r(i), the corresponding row of the eroded 
bitmap and {R(i)<-s R(i)~ v >} represent the shifting of row i by one bit to the left and right, 
respectively. The row-wise expression of erosion then becomes; 

5 

r(i) = R(i)« AND R(i) AND R(i)» AND R(i-l) AND R(i+1). 

Very high throughput can be achieved by use of computing machinery that 
includes an N-bit wide ALU, wherein N of the b(ij) may be computed simultaneously. Note 
1 0 too, that because the b(ij) depend only upon the B(i,j), several rows of b(i,j) can be 

computed in parallel by assigning a range of rows to each of several concurrently operating 
processors. 

Dilation is the process of enlarging objects by advancing their boundaries 
outward, into the space currently occupied by background. Using the notations and 

1 5 conventions described previously for bitmap erosion, the process of dilation may be 
expressed in terms of the following rules. Any bit whose value is one is either an interior 
point or a boundary point of an object. The corresponding bit in the dilated map should also 
be one. If a bit has value zero, and one or more of its eight nearest-neighbors is a one, then 
the bit is exterior to, and immediately adjacent to an object. Such bits should be set to one in 

20 the dilated map. These rules may be stated as bit operations as follows: 

b(ij) = B(i-1 OR B(ij-l) OR B(i+1 OR 
B(i-lj) ORB(i,j)ORB(i+lj) OR 
B(i-lj+l)ORB(i,j+l)OR B(i+lj+l). 

25 

The row-wise expression of the computation is. 

r(i) = R(i-1)« OR R(i-l) OR R(i-1)» OR 
R(i)« OR R(i) OR R(i)» OR 
30 R(i+1)« OR R(i+1) OR R(i+1)». 

As with erosion, the row-wise algorithm affords the possibility of many 
simultaneous calculations of the b(i,j) and can easily be adapted to a multiprocessing 
environment simply by assigning each processor its own range of r(i) to calculate. 

35 
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Additions to and variations on thess basic procedures appropriate to the 
various assays are disclosed below 

ASSAYS 

5 Numerous variations of the assay methods described below can be practiced 

in accordance with the invention. In general, a characteristic spatial and/or temporal 
distribution of one or more fluorescently-labeled species is used to quantify the assay. 
Advantageously, the fluorescence is observed from an essentially planar surface using a line- 
scan confocal microscope. This section is organized by assay-type according generally to 

10 increasing degree of complexity in the associated data analysis routine. The organization is 
not strict, however, because the analysis algorithms are often applicable to more than one 
assay-type. 

BINDING ASSAYS 

1 5 A first assay-type that can be advantageously performed according to the 

methods of the present invention is a binding assay. In general, the degree of binding of a 
fluorescently-labeled ligand to the target of interest is quantified from the analysis of one or 
more fluorescence images of a sample containing at least the target and the labeled ligand 
and obtained with the disclosed line-scan confocal imaging system. The ligands utilized 

20 include, but are not limited to, fluorophore conjugated natural and synthetic peptides and 
proteins, sugars, lipids, nucleic acid sequences, viral particles, bacteriophage particles, 
natural and synthetic toxins, known pharmaceutical agents, small organic molecules or 
synthetic analogues of neurotransmitters or intrinsically fluorescent small molecules, 
peptides or proteins, synthetic compounds from combinatorial libraries, random peptides, 

25 proteins from cDNA expression libraries, and peptidomimetics. (See Haugland R.P. 
Handbook of Fluorescent Probes and Research Chemicals 6"' Ed Chap. 18.) The targets 
include, but are not limited to cellular extracts or purified preparations of receptors, ligand- 
gated and ion-gated channel proteins, enzymes, transcription factors, cytoskeletal proteins, 
and antibodies and can be derived from viruses, bacteria, bacteriophages, invertebrate and 

30 vertebrate cells. Exemplary receptors include but are not limited to acetylcholine, adrenergic 
(a and p), muscarinic, dopamine, glycine, glutamine, serotonin, aspartate, gamma-amino 
butyric acid (GABA), purinergic, histamine, norepinephrine, Substance P, Neuropeptide Y, 
enkephaline, neurotensin, cholecystokinin (CCK), endorphin (opiod), melanocrotin/ACTH, 
somatostatin, parathyroid hormone, growth hormone, thyrotropin, thyroxin, cytokine, 

35 chemokine, insulin, insulin-like growth factor (IGF), stem cell factor, Luteinizing hormone- 
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releasing hormone, gonadotropin, angiotensin, endothelin, neurotensin, interferon, 
bradykinin, vasopressin, oxytocin, vasoactive intestinal polypeptide (VIP), corticotropin 
releasing-hormone, neurotrophin, erythropoetin, prostaglandin, leukotriene, thromboxane 
A2, calcitonin, T-cell, LDL/HDL, Epidermal growth factor (EGF), Estrogen, and Galainan. 

5 

BEAD-BASED BINDING 

Figs 15(a) - 15(f) depict the steps of an embodiment of a receptor-binding 
assay that can be performed according to the present invention. In Fig. 15(a), membranes 
210 prepared from cells or tissues and containing the receptor target 212 are added to a well 

1 0 220 containing a liquid 230. In Fig. 1 5(b), fluorescent-labeled ligands 214 are added to well 
220; these ligands bind to the membrane receptors 212. In Fig. 1 5(c), beads 224 are added 
to the well 220. Alternatively, the order of 15(b) and 1 5(c) may be interchanged, and in a 
preferred embodiment, the membrane-coated beads are prepared separately, prior to addition 
to the well. Beads 224 have a diameter in the range of approximately 1-20 pm and are 

15 coated with a material, such as wheat germ agglutinin, to which the membranes 210 adhere 
or have a surface that allows for the direct covalent or non-covalent binding of membranes. 

The foregoing steps are the same as those of the corresponding steps in the 
prior art SSA depicted in Figs. 1(a) - 1(f) except that the labels are fluorescent rather than 
radioactive. However, in the present invention, beads 224 are not luminescent and they have 

20 a density such that they sink to, or can be spun down to, the bottom of the well or are 
magnetic so that they can be moved to the bottom of the well using an external magnet. In 
Fig. 1 5(d), the fluorescent labels are imaged using, for example, a line-scan confocal 
microscope schematically depicted as element 240. In Fig. 1 5(e), a test compound 2 1 8 is 
added to the well. As in the prior art assays, the purpose of the present assay is to determine 

25 the extent to which the test compound displaces the fluorescently-labeled ligands 214 from 
the membrane receptors 212. In Fig. 1 5(f), the fluorescent labels still bound to the 
membranes 2 10 are imaged. By comparing the two fluorescent images, the activity of the 
test compound can be determined. 

In an alternative embodiment of the assay depicted in Figs. 15(a) - 15(f), the 

30 imaging step depicted in Fig. 1 5(d) can be eliminated and the activity of the test compound 
can be determined by comparing the image obtained in Fig. 15(f) to the image of a control 
well or the image expected from the known quantity of the fluorescent-labeled ligands added 
to the well and their known affinity to the receptors 

In a specific embodiment of the assay depicted in Figs. 15 (a) - 15 (f), the 

35 receptor is an antibody that recognizes the ligand, and the fluorescently-labeled ligand is 

- 32- 

SUBSTITUTE SHEET (RULE 26) 



WO 02/35474 



PCT/US00/29776 



added to the reaction along with a sample containing an unknown amount of unlabelled 
ligand. As in prior art radioimmunoassays, the purpose of the present assay is to determine 
the concentration of unlabelled ligand in the sample by measuring extent to which it displaces 
the fluorescently-labeled ligands 214 from the antibody receptor. 

5 

SURFACE BINDING 

Figs 1 6(a) - 16(f) depict the steps of a second embodiment of a receptor- 
binding assay according to the present invention. In Fig. 16(a), membranes 250 prepared 
from cells or tissues and containing the receptor target 252 are added to a well 260 
1 0 containing a liquid 270 The well bottom 262 is coated with a material such as wheat germ 
agglutinin, to which the membranes adhere. In Fig. 16(b), membranes 250 are shown bound 
to this material. Jn Fig 16(c), fluorescently-labeled ligands 254 are added to well 260 and 
bind to the membrane receptors 252. Alternatively, the order of Figs. 16(b) and 16(c) may 
be interchanged. 

1 5 In Fig. 16(d), the fluorescence of the fluorescent labels is imaged using, for 

example, a line-scan confocal microscope schematically depicted by element 280. In Fig. 
16(e), a test compound 258 is added to well 260. In Fig. 16(f), the fluorescent labels still 
attached to the membranes 250 are imaged and compared to the first image to determine the 
activity of test compound 258. 

20 In an alternative embodiment of the assay depicted in Figs. 16(a) - 16(f), the 

imaging in Fig. 16(d) can be eliminated and the activity of the test compound can be 
determined by comparing the image obtained in Fig. 16(f) to the image of a control well or 
the image expected from the known quantity of the fluorescent-labeled ligands added to the 
well and their known affinity to the receptors. 

25 

CELL-BASED BINDING 

In an alternative embodiment, ligand-target binding is advantageously assayed 
on collections of cells expressing the target. In general, there are a number of advantages to 
cell-based assays for screening chemical compounds. In particular, the activity of interest is 

30 measured in the presence of both competing and complementary' cellular processes affecting 
the biological activity of the compound. In cellular assays, cells prepared from cell lines or 
tissues are placed in tissue culture wells or on microscope slides. The cells can be live and 
intact or permeabilized with reagents such as digoxigenin, or, alternatively, fixed with 
reagents such as formaldehyde. One or more fluorescent-labelled ligands are added to the 

35 cells along with any non-fluorescent reagents required for the assay; the fluorescent-labelled 
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ligands bind to one or more components of the cells. A test compound is then added to the 
cells. Alternatively, the order of addition of fluorescent ligands and chemical compounds 
may be interchanged. The fluorescent labels are imaged using, for example, a line-scan 
confocal microscope schematically depicted as element 240. The purpose of the present 

5 assay is to determine the extent to which the test compound displaces the fluorescently- 
labeled ligands from the receptors. The fluorescent labels still bound to the cells are imaged 
in the presence and the absence of test compound. By comparing the two fluorescent 
images, the activity of the test compound can be determined. 

In an alternative embodiment of a cell-based receptor binding assay, the 

10 imaging step in the absence of compound can be eliminated and the activity of the test 

compound can be determined by comparing the image obtained in the presence of compound 
to the image of a control well or the image expected from the known quantity of the 
fluorescent-labeled ligands added to the well and their known affinity to the receptors. 

15 ADVANTAGES OF LIN ESC AN CONFOCAL IMAGING IN BINDING ASSAYS 

In a first embodiment, ligand-target binding is performed with one excitation 
wavelength and one emission wavelength. Data are provided in Fig, 24 exemplifying the 
speed and sensitivity of the present invention. A detailed analysis of its performance relative 
to the prior art wherein ligands are radiolabeled to allow for their detection, follows. The 

20 prior art for receptor-ligand assays includes SSA formats as well as formats in which bound 
and unbound ligand are physically separated and the amount of ligand bound to the receptor 
is measured by the addition of liquid scintillant 

First, the present invention can be used in small-volume wells, exemplarily 1 
p,L. In a receptor-ligand binding assay employing radiolabeled ligand, each radio label, J H 

25 for example, can decay only once, producing at most 90 photons per decay, at a decay rate of 
less than 10 s per second. A single fluorescent molecule, will produce 10'' - 10 7 photons in 
total, and it will emit between I0 3 and 10 6 photons per second. Thus, the count-rate for a 
fluorescent label is approximately 10" relative to J H. The present invention, therefore, 
requires immensely fewer labels, membranes and beads per well. For example, while a 

30 tritium SSA requires 10 7 beads per well, the present invention requires less than 10 3 beads 
per well. As a result, the present invention can be performed in uL-volume wells and in far 
less time In addition, in an SSA it is difficult to alter the imaging time, because radio labels 
decay at a fixed rate. In contrast, the excitation rate of fluorescent labels can be increased so 
as to increase the photon emission rate, thereby reducing the required imaging time. The 

35 excitation rate cannot, however, be increased without limit. In fact, it is the existence of the 
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so-called saturation limit of the fluorophore emission rate that underlies the substantial 
advantage of the line-scan confocal over the point-scan confocal in the present application. 
Second, the present invention does not require the time and expense of handling 
radioactivity. Third, because the present invention can be performed in small-volume wells, 

5 the compound and reagent consumption is much lower than for SSAs resulting in further cost 
reductions. Finally, the present invention does not require scintillant-doped beads or well 
bottoms, reducing costs even further. 

The present invention uses a line-scan confocal microscope to image the 
fluorescence of the sample in the well. The confocal aspect of the microscope allows for 

10 optical sectioning, i.e., detection of fluorescence from the plane in which the sample is 
located while minimizing the detection of fluorescence from the bulk of the solution. This 
eliminates the need for wash steps to remove unbound fluorescent-labeled ligand; this step, 
while it is not required in an SSA, is still required in any receptor-ligand binding assay, 
including RIA, in which scintillant containing beads are not used. The confocal aspect of the 

1 5 microscope also eliminates any interference that may originate from intrinsic fluorescent test 
compounds. The line-scan aspect allows the sample to be imaged more rapidly than in 
traditional point-scanning without losing appreciable background rejection. The speed 
increase depends on the fluorophore density, the lateral resolution, the field of view, and 
parameters of the hardware including the objective NA, the detection sensitivity and camera 

20 read-rate. Theoretically, the speed increase can approach the number of pixels per line, 

which is 1000 in a preferred embodiment of the present invention. Practically, the increase is 
approximately 100X. 

In order to quantify these advantages, an exemplary sample will be described. 
The assay is cell-based, wherein the location of the fluorescence is to be resolved to a 

25 precision of 1 p,m. Thus the image of a 1-mm diameter sample area will consist of ~10 3 lines 
of -10 3 pixels. The fluorescence signal of interest might originate from ligands on the cell 
surface or from a localized source within the cell, such as a receptor in the nucleus. In either 
case, the local concentration of the fluorophore is the important parameter. For an 
engineered cell line expressing ~I0 5 receptors per cell, the cell-averaged concentration is -1 

30 u.M. A few thousand receptors localized in the nucleus results in a comparable local 
concentration. Consistent with the desired lateral resolution of~l u.m, there are -2 x 10 3 
fluorophores per pixel It is assumed that the intrinsic cellular background fluorescence is 
less than, but on the order of, the label fluorescence, and that the desired signal-to-noise ratio 
is minimally 10 Then, the number of detected photons needs to be nearly 10 3 , taking into 

35 account the shot noise of the signal and background and the read noise of a high quality solid 
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state detector. The collection and detection efficiency of the present device, using an 
approximately 0.7 NA objective, blocking filters, and a solid state camera is -1%, requiring 
that - 1 0 5 photons be emitted per pixel, or - 1 0 : photons per molecule. It is desirable that the 
image be acquired in less than 1 second, preferably in a fraction of a second. If the pixels are 

5 acquired in a serial fashion, then the pixel dwell-time must be less than 1 ps, requiring a 
photon emission rate of greater than 10 8 per second per molecule. This is beyond the 
saturation value of most fluorophores, which is typically 10 6 . Importantly, the flux required 
to achieve saturation, 10 5 - 10 6 W/cnr, is sufficient to drive non-linear photo-induced 
bleaching of the fluorophores, as well. Finally, the highest efficiency detection devices 

1 0 cannot be used at the data rates required in serial scanning. By contrast, the emission rate 
per tluorophore need only be -10 5 if 1 0 3 pixels are illuminated simultaneously. The increased 
rejection of background fluorescence of point-scan confocal does not warrant the 
disadvantage of dramatically decreased scan speed. 

The exemplary data of Fig. 24 demonstrate that the disclosed system has 

1 5 sufficient sensitivity to quantify tens of fluorophores per bead, while clearly resolving 

hundreds of individual beads in less than 1 second. Comparable data can be acquired in cell- 
based binding experiments, as will be exemplified below. 



DATA ANALYSIS 

20 The data analysis routines are closely related whether the binding be cell- 

based or bead-based and are presented together, below. The data can be analyzed by the 
following routines, the simplest of which is the Threshold Image Analysis algorithm. The 
purpose of the routine is to determine the amount of a fluorescently-labeled species that is 
localized in a contiguous or punctate manner so as to exceed a minimum fluorescence 

25 intensity, and optionally so as to not exceed a maximum fluorescence intensity. In one 
embodiment the analysis is used to assay the activity of a chemical compound. 
The steps of the algorithm are as follows: 

1 . Acquire a digitized image of the labeled species. 

2. Open file row-by-row and 

30 i. Subtract camera offset value from image, 

ii Multiply each row in the image by the inverse of the corresponding 
row in the flat-field image file. 

3. Optionally, histogram the image to determine the background level 

4. Establish selection criteria including a minimum value and optionally a 

35 maximum value The values are determined, for example, as a fixed multiple 
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of the mean background level, as a fixed number of counts above the mean 
background level, by statistical analysis on the background histogram peak 
width or by using a pre-determined value. 
5. Compare each pixel in the image to the selection criteria. For each pixel in the 
5 image meeting the criteria, add the value to a running sum. The total number 

of qualified pixels and the average intensity are reported. 

This routine is used advantageously to process data similar to that in Fig. 24, in which the 
individual beads are clearly distinguishable from the background and the artefacts due to 

10 clumped beads or cells are small. Such a routine is appropriate for the assay-type having 
membranes bound to the well bottom, as well. 

A second routine applicable to analyzing binding data is the Localization 
Analysis algorithm which entails an additional shape analysis protocol As with the Threshold 
routine, the purpose is to determine the amount of a fluorescently-labeled species that is 

1 5 localized in a contiguous or punctate manner. In one embodiment the analysis is used to 
assay the activity of a chemical compound. 

The steps of the algorithm are as follows: 



1 . Acquire image of the labeled species. 
2 Open file row-by-row and 
20 i. Subtract camera offset value from the image, 

ii. Multiply each row in the image by the inverse of the corresponding 
row in the flat-field image file. 

3. Optionally, histogram and sum the pixel values of the image. 

4. Establish selection criteria including a minimum value and optionally a 

25 maximum value. The values are determined, for example, as a fixed multiple 

of the mean background level, as a fixed number of counts above the mean 
background level, by statistical analysis on the background histogram peak 
width or by using a pre-determined value. 

5. Compare each pixel in the image to the selection criteria. All qualified pixels 
30 are assigned a value of 1 and all others are assigned a value of 0, thereby 

effecting a 1 6- to 1 -bit compression. 

6 "Clean" the edge of the image by setting to 0 all 1 -valued contiguous pixels in 
the binary mask having an edge-touching member. 

7 Search the bitmap for objects, defined as groups of contiguous value-1 pixels, 
35 by. 
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i Searching the image in a line-by-line pattern to find a pixel of value 1 . 

ii Determining all value- 1 pixels contiguous to the pixel identified in i). 

iii Optionally, applying a minimum and maximum size filter to the object, 
the sizes having been previously determined. 

iv If the object qualifies, proceed to step 8, otherwise change all 1-valued 
pixels in the object to 0 and continue searching for next object 

v If the end of the bitmap is reached, proceed to step 9. 
For each object passing the filter criteria: 

i Optionally, create a new rectangular bitmap with extended borders 
that contains the object plus n extra 0 pixels in each direction from the 
edge of the object. /; is the number of dilation steps to be performed 
below and has been previously determined. 

ii If step 8.i. was implemented, then dilate the object by applying a 
dilation step n times in which pixels of value 0 that touch 1 -valued 
pixels are set to value 1 . 

iii For each collection of 1-valued pixels in either the dilated bitmap, or in 
the original bitmap if step 8.i. was not implemented, sum and average 
the corresponding pixel values from the image to calculate the average 
pixel intensities under the mask. 

iv Change to 0 all pixels of the object in the original bitmap image and 
return to step 7 to search for more objects. 

After all objects have been counted, the average intensity of the fluorescently- 
labeled species per object and optionally the fraction of the total intensity of 
the species localized is calculated for all objects in the image and reported 
together with statistical information such as the standard deviation. 



The distinguishing operation in this routine, shared by all the following 
algorithms, is the creation of the binary mask in steps 4-6 The selection criteria of objects 
for the mask can optionally include minimum and maximum values, size and shape. For 
30 example, in one embodiment, the analysis routine for the bead-based assays include a 
roundness filter in step 7 iii. 

In a second embodiment, the emission of two or more fluorescently-labeled 
species is detected simultaneously, excited by one or more illumination wavelengths. As 
applied in a binding assay, the first fluorescently-labeled species is used to identify the object 
35 to which the second fluorescently-labeled species binds. Two examples of two-color cell- 
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based binding assays are provided in Figs. 21 and 23. An exemplary' procedure that can be 
used to analyze such images is the Co-localization Analysis routine which is designed to 
determine the amount of a first fluorescently-labeled species localized with respect to a 
second fluorescently-labeled species. In one embodiment the analysis is used to assay the 
activity of a chemical compound, for example, where activity depends on a subcellular 
localization of interest. 

The steps of the algorithm are as follows: 

1 . Acquire digitized images of the first and second labeled species respectively. 

2. Open files row-by-row and 

) i. Subtract respective camera offset values from each image, 

ii. Multiply each row in each image by the inverse of the corresponding 
row in its respective flat field image file. 

3 . Optionally, histogram the image of the first species to determine the 
background level and sum the intensity of the image of the second species. 

5 4. Establish selection criteria including a minimum value and optionally a 

maximum value These values are determined, for example, as a fixed 
multiple of the mean background level, as a fixed number of counts above the 
mean background level, by statistical analysis on the background histogram 
peak width or by using a pre-determined value. 

0 5, Compare each pixel in the image of the first species to the selection criteria. 

All qualified pixels are assigned a value of 1 and all others are assigned a value 
of 0, thereby effecting a 16- to 1-bit compression. 
6. "Clean" the edge of the image by setting to 0 all 1 -valued contiguous pixels in 
the binary mask having an edge-touching member. 

5 7. Search the bitmap for objects, defined as groups of contiguous value- 1 pixels, 

by: 

Searching the image in a line-by-line pattern to find a pixel of value 1 
Determining all value- 1 pixels contiguous to the pixel identified in i). 
Optionally, applying a minimum and maximum size filter to the object, 
the sizes having been previously determined. 

iv If the object qualifies, proceed to step 8, otherwise change all 1 -valued 
pixels in the object to 0 and continue searching for next object. 

v If the end of the bitmap is reached, proceed to step 9 
For each object passing the filter criteria: 
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i Optionally, create a new rectangular bitmap with extended borders 
that contains the object plus n extra 0 pixels in each direction from the 
edge of the object // is the number of dilation steps to be performed 
below and has been previously determined. 

ii If step 8 i. was implemented, then dilate the object by applying a 
dilation step n times in which pixels of value 0 that touch 1 -valued 
pixels are set to value 1 . 

iii For each collection of 1 -valued pixels in either the dilated bitmap, or 
the original bitmap if step 81 was not executed, sum and average the 
corresponding pixel values from the image of the second species to 
calculate the average pixel intensities under the mask 

iv Change to 0 all pixels of the object in the original bitmap image and 
return to step 7 to search for more objects. 

After all objects have been counted, the average intensity of the second 
fluorescently-labeled species per object and optionally the fraction of the total 
intensity of the second species co-localized with the first species is calculated 
for all objects in the image and reported together with statistical information 
such as the standard deviation. 



20 The advantage of this more elaborate routine is that the object, whether it be a 

cell or a bead, can be independently identified. As exemplified in Fig. 21, not all cells 
respond. The independent identification of cells, enables, for example, the ratio of 
responding to non-responding cells to be tabulated along with the degree of response among 
those that respond. This algorithm, despite its additional complexity, can be implemented so 

25 as to analyze 1 -Megapixel images in under 1 second on a Pentium II platform. 



TRANSLOCATION ASSAYS 

An additional assay-type that can be performed advantageously according to 
the second embodiment, that is where the emission of two or more fluorescently-labeled 

30 species is detected simultaneously, excited by one or more illumination wavelengths, is the 
translocation assay In these assays, the translocation of interest is of one or more species, 
which may be proteins, lipids or other molecular complexes or sub-cellular structures such as 
vesicles, from one well-defined region of a cell to another. These include but are not limited 
to: synaptin (vesicle membrane protein), transcription factors (NF-kB, NFAT, AP-1), 

35 hormone receptors, LDL/HDL receptors, T-cell receptors, and PTH receptors. 
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The prototypical translocation assay is a special case of the co-localization 
measurement. Exemplarily, the co-localization of the first and second species is quantified by 
the fraction of the second species co-localized with respect to the first, or the ratio of the 
second species co-localized with the first and that resident elsewhere in the cell. An 
5 expanded analysis routine preferentially used to process translocation image data is provided 
below. 

The labeled location is the cell nucleus, the label being a fluorophore specific 
for DNA, such as Hoechst 33342. Other nucleic acid specific stains are known in the art 
(e.g., see Haugland, R P. Handbook of Fluorescent Probes and Research Chemicals, 6 th Ed. 
10 Chapter 8). The second species is a transcription factor whose migration from the cytoplasm 
to the nucleus is the subject of the assay. This protein can be labeled by a variety of methods, 
including expression as a fusion with GFP, and contacting the sample with a fluorescently- 
labeled antibody specific to the transcription factor protein. 

The following Translocation Data Analysis routine can be used to determine 
1 5 the amount of a first fluorescently-labeled species that is distributed in a correlated or anti- 
correlated manner with respect to a second fluorescently-labeled species. In one embodiment 
the analysis is used to assay the activity of a chemical compound. 
The steps of the algorithm are as follows: 
1 . Acquire images of the first and second labeled species respectively. 
20 2. Open files row-by-row and 

i. Subtract respective camera offset values from each image, 

ii. Multiply each row in each image by the inverse of the corresponding 
row in its respective flat-field image file 

3 . Optionally, histogram the image of the first species to determine the 

25 background level and sum the intensity of the image of the second species. 

4. Establish selection criteria including a minimum value and optionally a 
maximum value. These values are determined, for example, as a fixed 
multiple of the mean background level, as a fixed number of counts above the 
mean background level, by statistical analysis on the background histogram 

30 peak width or by using a pre-determined value 

5. Compare each pixel in the image of the first species to the selection criteria 
All qualified pixels are assigned a value of 1 and all others are assigned a value 
of 0, thereby effecting a 16- to 1-bit compression. 

6. "Clean' the edge of the image by setting to 0 all 1 -valued contiguous pixels in 
35 the binary mask having an edge-touching member 
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Search the bitmap for objects, defined as groups of contiguous value- 1 pixels, 
by: 

i Searching the image in a line-by-line pattern to find a pixel of value 1. 

ii Determining all value- 1 pixels contiguous to the pixel identified in i). 

iii Optionally, applying a minimum and maximum size filter to the object, 
the size having been previously determined. 

iv If the object qualifies, proceed to step 8, otherwise change all 1 -valued 
pixels in the object to 0 and continue searching for next object. 

v If the end of the bitmap is reached, proceed to step 9. 
For each object passing the filter criteria: 

i Create a new rectangular bitmap with extended borders that contains 
the object plus /? extra 0 pixels in each direction from the edge of the 
object, n is the number of dilation steps to be performed below and has 
been previously determined. 

ii Dilate the object by applying a dilation step n times in which pixels of 
value 0 that touch 1 -valued pixels are set to value 1 . 

iii Compare the dilated bitmap with the original full size bitmap. Set to 0 
all pixels in the dilated bitmap that are 1 -valued in the corresponding 
region of the original bitmap. This produces an annular mask and 
ensures only one object is captured when the bitmap borders were 
increased during dilation. 

iv Create another bitmap from the original object, erode it m times by 
setting to 0 value-1 pixels touching value-0 pixels, m is typically equal 
to // and determined previously. 

v For each collection of 1 -valued pixels in the annular and eroded 
bitmaps, average the corresponding pixel values from the image of the 
second species to calculate the average pixel intensities under the 
eroded and annular masks. 

vi Calculate the ratio of eroded to annular intensities for each object and 
save in a table. 

vii Change to 0 all pixels of the object in the original bitmap image and 
return to step 7 to search for more objects. 

After all objects have been counted, the average intensity ratio of all objects in 
the image is calculated along with statistical information such as the standard 
deviation. 
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The new feature of this routine over those disclosed above is the creation in 
Step 8 of two daughter masks, one an annular extension of the primary mask, and one an 
eroded version of the primary mask. The latter is used to quantify the co-localization of 
species-two with species-one, the transcription factor and the cell nucleus (actually, DNA), 

5 respectively, in the present example. The former mask is used to quantify species-two not 
co-localized In the present example, the ratio of these two quantities is formed on an cell- 
by-cell basis and the results tabulated. 

According to the methods of the present invention, the data acquisition and 
analysis can be performed in approximately one second. For comparison, two prior art 

10 examples are cited. In Ding et al. (J. Biol. Chem, 273, 28897-28905 (1998)), a comparable 
two-color translocation assay was performed. The advantages of the present invention 
include; 1) approximately 50X faster image acquisition per data channel, 2) simultaneous 
two-color image acquisition, 3) superior sensitivity of approximately 10X, permitting lower 
staining levels, 4) confocal detection, allowing elimination of a rinse step, 5) focus-time of 

15 approximately 0.1 s compared to approximately 30 s, 6) data analysis time of approximately 
0.2 s/frame compared to 3-6 s/frame, and 7) continuous image acquisition. The second 
example of prior art is Deptala et al. (Cytometry, 33, 376-382, (1998)). The present 
invention provides 1) higher spatial resolution, approximately 4X, 2) approximately 16X 
higher pixel acquisition rates, 3) faster data analysis, 4) autofocus operable in microliter 

20 plates, and 5) data analysis time of approximately 0.2 s/frame compared to 3-6 s/frame. 

ENDOCYTOSIS, EXOCYTOS1S AND RECEPTOR SEQUESTRATION 

Endocytosis and exocytosis, generally, and receptor sequestration and 
recycling, specifically, are additional processes that can be assayed according to the first or 

25 second embodiments and the associated image analysis protocols disclosed above. 

Fluorescence labeling can be accomplished according to a variety of known methods. For 
example, an elegant experiment comprising the labeling of both the receptor and ligand is 
disclosed by Tarasova et al. (J. Biol. Chem., 272, 14817-14824 (1997)). The present 
imaging system is approximately 50X faster per data channel and acquires the two images 

30 simultaneously. In addition, the present analysis protocols, the Co-localization algorithm for 
example, can be used to process sequestration image data in real-time. No such examples are 
known in the prior art. 

Many other assays requiring similar imaging and analysis capabilities are 
known in the art. For example, assays involving phagocytosis and related cellular events, 

35 (eg, J Immunology, (1983) 130, 1910, J. Leukocyte Biol (1988) 43, 304), additional 
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assays involving both receptor-mediated and non-receptor-mediated endocytosis and 
exocytosis (e.g. Neuron 14, 983 (1995), J. Physiol. 460, 287 (1993) and Science 255, 200 
(1992), including receptor-mediated endocytosis of Low-Density Lipoprotein Complexes 
(see J Cell Biol. 121, 1257 (1993) and the delivery of Transferin to vertebrate cells (see Cell 

5 49, 423 (1994)); imaging the endocytosis and lateral mobility of fluorescently-labeled 

epidermal growth factor (see Proc. Natl. Acad. Sci. USA 75, 2135 (1975); J. Cell Biol. 109, 
2105 (1989)); monitoring the uptake and internal processing of exogenous materials by 
endocytosis of fluorescent dextrans (see J. Biol. Chem. 269, 12918 (1994)), and the imaging 
of the endocytosis-mediated recycling of synaptic vesicles in actively firing neurons by use of 

10 hydrophilic dyes (see Nature 314, 357 (1985)). [n addition, the genetic engineering of cell 
lines expressing green fluorescent protein (GFP)fused to proteins that localize to exocytotic 
and secretory vesicles (such as chromogranin B, a secretory granule protein (see J. Cell Sci. 
110,1453 (1997) or tPA which is localized to growth cones in differentiated neuronal cells 
(see Mol. Biol, Cell 9: 2463 (1998)) allow for the monitoring of exocytosis. A wide variety 

1 5 of fluorescent labels are available for such assays (See Haugland R.P. Handbook of 
Fluorescent Probes and Research chemicals, 6"' Ed. Chap. 1 7). 

ION CHANNELS 

A third embodiment of the present invention, one version of which is depicted 
20 in Fig. 9, can be used to image the time-dependent response of one or more fluorescently- 
labeled species at a rate of approximately 30 frames per second. This permits the capture of 
transient phenomenon, such as the opening and closing of ion channels. Exemplary ion 
channels include but are not limited to: EC-gated voltage, Na~-gated voltage, Ca^-gated 
voltage, CI", NaVFC ATPase, and P-glycoproteins. 
25 The following Kinetic Imaging Data Analysis algorithm defines and tracks 

individual cells from frame to frame, enabling simultaneous kinetic analysis on a sufficient 
number of cells to obtain statistically meaningful data. 

The steps of the algorithm are as follows: 
1 . Acquire one (indicator only), two (marker and indicator or two indicators) or 
30 more digitized images as a function of time. 

2 Open files row-by-row and 

i Subtract respective camera offset values from each image, 
ii. Multiply each row in each image by the inverse of the corresponding 
row in its respective flat-field image file Subtract respective camera 
35 offset values from each image. 
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3. Optionally, histogram the image of the first species to determine the 
background level. 

4 Establish selection criteria including a minimum value and optionally a 

maximum value. The values are determined, for example, as a fixed multiple 
5 of the mean background level, as a fixed number of counts above the mean 

background level, by statistical analysis on the background histogram peak 
width or by using a pre-determined value. 

5 . Compare each pixel in the image of the first species to the selection criteria. 
All qualified pixels are assigned a value of 1 and all others are assigned a value 

1 0 of 0, thereby effecting a 16- to 1-bit compression. 

6. "Clean" the edge of the image by setting to 0 all 1 -valued contiguous pixels in 
the binary mask having an edge-touching member. 

7. Search the bitmap for objects, defined as groups of contiguous value- 1 pixels, 
by: 

1 5 i Searching the image in a line-by-line pattern to find a pixel of value 1 . 

ii Determining all value- 1 pixels contiguous to the pixel identified in i. 

iii. Optionally, applying a minimum and maximum size filter to the object, 
the size having been previously determined. 

iv. rf the object qualifies, proceed to step 8, otherwise change to 0 all 1- 
20 valued pixels in the object and continue searching for next object. 

v. If the end of the bitmap is reached, proceed to step 9. 

8 For each object passing the filter criteria: average the corresponding pixels 

from each of the images in the time series. If a single indicator is used, record 
the intensities. If ratiometric indicators are used, divide the value of one 
25 image by the other for each image in the time series and record the results. 

9. After all objects have been analyzed, the results of the analysis of step 8 are 
reported for each object. Kinetic parameters, including the rise time, fall time 
and amplitude are reported for each object as are statistical information 
derived from the set of kinetic analyses and from the set of all objects at fixed 
30 times. 

Two examples of the use of the present invention to image and analyze 
transient events associated with ion channels are provided in Figs. 1 9 and 20. These assays 
used the Ca* '-sensitive dye, Fluo-3 to indicate the changes in intra-cellular Ca"~ 
35 concentration In the first of the experiments, the change was caused by a Ca"" second signal 
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initiated by the activation of acetylcholine receptors, and in the second experiment the change 
was due to activation of voltage-gated Ca"~ channels. 

Ion channels have been an area of intense research activity in recent years. 
The advantages of the present invention over the prior art will be made clear by the following 
5 comparisons. 

In compound screening applications, a prior art standard, cited in the 
Background Section, is disclosed in U.S. Patent No. 5,355,215. This device, used primarily 
for detecting induced changes in intracellular Ca 2 ", includes a dispenser to initiate transient 
events The principal advantages of the present invention over this prior art are the 
10 following: 1) imaging and analysis permitting the determination of individual cellular 
responses as compared to a response averaged over the well, 2) increased sensitivity, 
requiring lower reagent loading and lower illumination intensity, and enabling smaller sample 
volumes, and 3) the acquisition of images at video rates compared to a maximum rate of 1 
point per second. 

1 5 in research applications, the system of Tsien and co-workers disclosed in the 

Handbook of Biological Confocal Microscopy, J. B. Pawley, ed., Plenum Press, New York, 
1995, pp. 459-478, serves as a standard. It has a demonstrated capability to image at rates 
beyond the present invention. This cannot be accomplished, however, on samples presently 
of interest. The prior art requires 10 2 -10 3 greater fluorophores per pixel to achieve rates 

20 comparable to the present invention at a comparable signal-to-noise ratio. In addition, the 
present invention can acquire images at 12- or 16-bit resolution, giving it a 4-16X greater 
dynamic range. 

A second example of a research system is disclosed in Sun et al., J. 
Physiology, 509, 67-80, 1998. According to Sun, data is generated at rates up to 650 Hz per 

25 600-pixel line with 5 microsecond per pixel integration time, using a conventional spot 
scanning confocal microscope Only one-dimensional "imaging" is performed. Transients 
can be monitored for objects lying along the scanned line In addition, this rate could only be 
achieved with 1-ps pixel integration time, requiring a 10~-10 3 greater concentration of 
fluorophores to achieve image quality comparable to the present invention. 

30 The capabilities of the present invention to image and analyze changes in 

intra-cellular ion concentrations in response to external stimuli has multiple applications in 
compound screening and in general biological research applications (See e.g. J. Cell Biol 
137(3), 633-648 (1997), J. Biol Chem. 271(9), 4999-5006 (1996); Science 280, 69-76 
(1998), Biochem, J , 324, 645-651 (1997)). A wide variety of fluorescent indicators are 

35 available sensitive to specific ions (see Haugland R P. Handbook of Fluorescent Probes and 
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Research Chemicals, 6* Ed. Chaps 18, 22 and 24). These indicators allow measurement of' 
concentrations of Mg 2 \ Zn~\ Ca 2 '\ Na\ Fe 2+ Hg 2 ", Pb 2 ~ Cd 2 ", Nf*, Co 2 " Al 3 ', Ga 2+ , Eu 3 ", 
Tb 3 ', Tb 3 ', Sm 3 ", and Dy 3 '. In addition, assays for Na*"and K' can be performed even in the 
presence of physiological concentrations of other monovalent cations (see J. Biol. Chem. 

5 264, 1 9449 ( 1 989)), including assays of Na l levels or Na + efflux in a variety of cells such as 
blood, brain and muscle cells (see J. biol Chem. 268, 18640 (1993); J Neurosci 14, 2464 
(1994); Am J. Physiol, 267, H568 (1994)), and changes in K~ in sperm cells, nerve terminals 
synaptosomes and lymphocytes. In addition, the present invention can be used to assay CI" 
concentrations in vesicles, liposomes and live cells (see Am. J. Physiol. 259, c375 (1990). 

1 0 In addition, the present invention can be used to assay changes in membrane 

potential in cells and sub-cellular organelles The ability to rapidly image changes in 
membrane potential is vital to assays for cell and organelle viability, nerve-impulse 
generation, muscle contraction, cell signaling and ion-channel gating (see Biophys J. 67, 208 
(1994); Neuron 13, 1 187 (1994); J. Membrane Biol. 130,1 (1992)). Fluorescent indicators 

1 5 are available that respond to fast (millisecond) potential changes in excitable cells such as 
neurons, cardiac cells and intact brain cells. (See Haugland R.P. Handbook of Fluorescent 
probes and Research Chemicals, 6 th Ed. Chap. 25). The fluorescent probes that respond to 
fast transmembrane potential changes typically show only a 2-10% change in fluorescence 
per lOOmv. The plasma membrane of a cell has a transmembrane potential of approximately 

20 -70mv and some organelles such as mitochondria maintain transmembrane potentials of - 
150mV. Thus, assays involving such rapid changes require the high sensitivity, rapid data 
acquisition ability common to the various embodiments of the present invention. 

FRET-BASED MEASUREMENTS 

25 The present invention can be advantageously used to perform assays which 

involve fluorescence resonance energy transfer (FRET). FRET occurs when one 
fluorophore, the donor, absorbs a photon and transfers the absorbed energy non-radiatively 
to another fluorophore, the acceptor The acceptor then emits the energy at its characteristic 
wavelength. The donor and acceptor molecules must be in close proximity, less than 

30 approximately 10 nm, for efficient energy transfer to occur (see Methods Enzymol. 21 1, 353 
- 388 (1992); Methods Enzymol. 246, 300-334 (1995)). The proximity requirement can be 
used to construct assays sensitive to small separations between the donor-acceptor pair. 
FRET typically requires a single excitation wavelength and two emission wavelengths, and an 
analysis consisting of the ratio of the donor and acceptor emission intensities. FRET donor 

35 acceptor pairs can be constructed for both bead-based assays and cell-based assays Several 
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green fluorescent protein (GFP) mutants displaying enhanced fluorescence and altered 
emission wavelengths can be paired for FRET cell-based assays by fusing the GFP FRET 
donor to one protein and the GFP FRET acceptor to either the same protein or to another 
protein expressed within the same cell Such FRET pairing can be used to measure 
5 intramolecular changes, such as Ca-'-calmodulin binding of Ca 2 ' or intermolecular 

interactions, such as receptor dimerization. The Kinetic Imaging algorithm disclosed above 
can be preferentially used. 

TRANSIENT TRANSFECTION 

1 0 Among the significant advantages of an image-based measurement is the 

opportunity both to observe rare events, lost within the average, and to normalize the 
primary response on an object-by-object basis to a secondary, response. Both features can be 
important in assays using a cell line having a transiently transfected target. Gene expression 
and subsequent protein production following transfection is often inefficient and transient 

1 5 (see BioTechniques 24:478-482 (1998)). Methods to monitor the transfection efficiency that 
can be advantageously used with the present invention are known in the art. For example, 
the gene of interest can be transfected together with the gene for green fluorescent protein 
(GFP), so that the two proteins will be expressed either as a fusion or as separate entities. 
The present invention can be used to measure the amount of indicator present at one 

20 wavelength and the response associated with the target at another. The former signal can be 
used to normalize the response of the latter for the amount of target present. This allows the 
present invention to perform assays on targets too unstable to be used in currently available 
screening and to monitor transfection efficiencies of only a few percent. The Kinetic Imaging 
algorithm disclosed above can be used to analyze such data, where only one image frame is 

25 required. Viral infection of cells can be monitored, either directly through expression of viral 
proteins, or indirectly by acquisition of a new phenotype, even if only a few percent of cells 
are infected. Finally, this invention provides a method for detecting a rare event, such as the 
acquisition of a new phenotype by an individual cell or group of cells due to the transfection 
of a specific cDNA as a result of the transfection of the entire cell population with a library of 

30 diverse cDNAs. 

ENZYME ASSAYS 

The present invention can also be used to conduct general assays of enzyme 
activity. Exemplary intracellular enzymes include but are not limited to: carbonic anhydrase, 
35 guanine nucleotide-binding proteins (G proteins), adenyl cyclase, calmodulin, PI, PIP and 
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P1P2 kinases, cAMP kinase and cAMP hydrolase, cytochrome P-450, serine/threonine 
protein kinases, tyrosine protein kinases, protein phosphatases, [3-lactamase, P-galactosidase, 
dihydrofolate reductase, phosphodiesterases, caspases, proteosome proteases, nitric oxide 
synthase, thymidine kinase, nucleoside deaminase, glutathione-S-transferase, lipoxygenases, 

5 and phospholipases. 

Figs. 17(a) - 17(d) depict the steps of a First embodiment of an enzyme assay 
according to the present invention. In Fig. 17(a), beads 310 with a known quantity of 
fluorescent-labeled peptides 3 12 attached thereto are added to a well 320 containing a liquid 
330. Beads 310 have a density such that they sink to the bottom of the well. In Fig. 17(b), a 

10 test compound 3 14 is added to the well. In Fig 17(c), enzymes 316 are added to the well. 
The order of the steps depicted in Figs. 17(a), 17(b) and 17(c) is interchangeable except that 
at no time should the well contain the peptides and enzymes without the test compound. If 
not inhibited, enzymes 316 will cleave peptides 312, and the fluorescent labels will diffuse 
into the liquid. If, on the other hand, test compound 314 inhibits enzymes 316, typically by 

15 blocking the enzyme active sites, enzymes 3 16 will not cleave the fluorescent labels. In Fig. 
17(d), the fluorescent labels still attached to the beads are imaged using, for example, a line- 
scan confocal microscope schematically depicted as element 340. From this image, the 
activity of test compound 314 can be determined. 

In an alternative embodiment of the assay depicted in Figs. 1 7(a) - 1 7(d), the 

20 activity of the test compound can be determined by comparing the image obtained in Fig. 
17(d) to the image obtained by imaging the fluorescence of the fluorescent labels in Figs. 
17(a) or 17(b) or the image of a control well. 

Figs. 18(a) - 18(d) depict the steps of a second embodiment of an enzyme 
assay according to the present invention. In Fig. 1 8(a), a known quantity of fluorescent- 

25 labeled peptides 352 are attached to the bottom 362 of a well 360 In Fig. 18(b), a test 
compound 354 is added to the well. In Fig. 18(c), enzymes 35b are added to the well. In 
Fig 18(d), the fluorescent labels still attached to the bottom of the well are imaged using, for 
example, a line-scan confocal microscope schematically depicted as element 380 to determine 
the activity of test compound 354. 

30 In an alternative embodiment of the assay depicted in Figs. 18(a) - 1 8(d), the 

activity of the test compound can be determined by comparing the image obtained in Fig. 
18(d) to the image obtained by imaging the fluorescence of the fluorescent labels in Figs. 
18(a) or 18(b) or the image of a control well 

Another example of an assay that may be performed according to the present 

35 invention is a tyrosine kinase assay Tyrosine kinases phosphorylate tyrosine residues of 
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substrate peptides. The substrate peptide has both a tyrosine residue and a fluorescent tag. 
In this assay, an antibody that at one end is selective for phosphorylated tyrosine is bound at 
the other end to a surface such as a bead or the bottom of a well. Tyrosine kinase and a 
fluorescent-tagged peptide with a tyrosine residue are added to the well. If the tyrosine 

5 kinase phosphorylates the peptide, the phosphorylated tyrosine will bind to the antibody, 
thereby localizing the fluorescent tag on the surface to which the antibody is attached. If the 
tyrosine kinase does not phosphorylate the peptide, the fluorescent tags on the peptides will 
be dispersed throughout the well. The extent of phosphorylation of the peptide can be 
determined by measuring the fluorescence adjacent to the surface. Such an assay can also be 

10 conducted where an antibody is used that is specific to the fluorescent product produced by 
the action of the enzyme upon the fluorescent substrate. 

In addition, live-cell enzyme assays can be performed according to the present 
invention. A number of techniques for investigating enzymatic activity in live cells are known 
in the art (See Biochem. Histochem 70,243 (1995), J. Fluorescence 3, 119 (1993)) as are 

1 5 substrates that yield fluorescent products when acted on by enzymes (See Haugland R P. 
Handbook of Fluorescent Probes and Research Chemical 6 lh Ed. Chap. 10). In general, 
these assays use probes that passively enter the cell and are subsequently processed by 
intracellular enzymes to generate products retained within the cell. Other substrates yield 
insoluble fluorescent products that precipitate at the site of enzymatic activity The present 

20 invention can assay the degree of enzymatic activity and determine the precise spatial 

localization of the enzymatic activity using such probes Probes are available for assaying a 
wide variety of enzymes using the present invention including but not limited to 
phosphatases, ATPases, 5'-nucleotidase, DNA and RNA polymerases, peptidases, proteases, 
esterases and peroxidase. 

25 Enzyme activity assays can be performed according either the first or second 

experimental embodiments and the associated image analysis protocols disclosed above. 

MORPHOLOGY 

The methods of the present invention can also be used to perform assays that 
30 require a determination of cellular or sub-cellular morphology, including but not limited to 
axons and organelles. To perform such assays, a fluorescent probe is introduced into the 
structure of interest, such as a cell or organelle, by direct micro-injection or by contacting 
cells with cell-permeant reagents that are metabolized or otherwise altered so as to be 
retained in the structure of interest. If it is to be used with live cells, the fluorescent label 
35 must be non-toxic and biologically inert. Many appropriate dyes are available commercially 
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(See Haugland R.P. Handbook of Fluorescent Probes and Research Chemicals 6 lh Ed, Chap. 
1 5) for use in assays, for example, involving flow in capillaries, neuronal cell connectivity, 
translocation of dye through gap junctions, cell division and cell lysis and liposome fusion 
In addition, these tracers can be used to track movement of labeled cells in culture, tissues or 

5 intact organisms, Many techniques employing fluorescent tracers to assay cell or sub-cellular 
morphology or movement are known in the art and may involve use of membrane tracers, 
biotinylated dextran conjugators, fluorescent microspheres or proteins and protein conjugates 
(SeeMeth. Cell Biol 29, 153 (1989); Cytometry 21. 230(1995); Cell 84, 381 (1996); 
Biochem. Biophys. Acta 988, 3 19 (1989); Cytometry 14, 747 (1 993). The various 

10 embodiments of the present invention have significant advantages when used in these types of 
assays. The present invention allows rapid imaging of multiple parameters with very fine 
spatial resolution. 

NUCLEIC ACIDS 

1 5 The present invention can also be used to conduct assays of nucleic acids. A 

specific DNA assay that would benefit from the spatial resolution and multi-wavelength 
imaging capability of the present invention is fluorescence-in-situ hybridization (FISH). 
FISH is an important technique for localizing and determining the relative abundance of 
specific nucleic acid sequences in cells, tissue, interphase nuclei and metaphase chromosomes 

20 and is used in clinical diagnostics and gene mapping (see Histo-chem J. 27, 4 (1995); Science 
247, 64 (1990); Trends Genet. 9, 71 (1993) and Science 250, 559 (1990)) A variety of 
fluorescent hybridization probes are available for multicolor fluorescent DNA and RNA 
hybridization techniques (see Haugland R P. Handbook of Fluorescent Probes and Research 
Chemicals, 6 th Ed. Chap. 8.4). An additional technique determines chromosome banding by 

25 the use of an AT or GC selective DNA-dyes with a nucleic acid counter stain. This technique 
is widely used for karotype analysis and chromosome structure studies (see Human Genet. 
57,1 (1981)). 

REACTIVE OXYGEN SPECIES 

30 The present invention can also be used to assay levels of various reactive 

oxygen species such as singlet oxygen, superoxides and nitric oxide The importance of these 
reactive oxygen species has only recently been realized (See Biochem Pharmacol 47,373 
(1994), J. Cell Biol 126, 901 (1994)) It is now known that singlet oxygen is responsible for 
much of the physiological damage caused by reactive oxygen species (See J. Photochem. 

35 Photobiol. 1 1,241 (1991)). Nitric Oxide (NO), in particular, is now known to play a critical 
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role as a molecular mediator in a variety of physiological processes including 
neurotransmission and blood-pressure regulation (See Current Biology 2,437 (1995), J. Med 
Chem. 38,4343 (1995), Cell 78, 919 (1994)). Techniques are known in the art to perform 
assays to measure NO indirectly. For example, under physiological conditions, NO is 
5 oxidized to nitrite and this can be detected by monitoring absorbance at 548 nm or by use of 
a probe which reacts with nitrite to form an identifiable fluorescent product. (See Haugland 
R. P., Handbook of Fluorescent Probes and Research Chemicals 6 th Ed. Chap. 21). 

PH 

10 The present invention can also be used to perform assays involving 

measurements of pH changes within cells or in cell-free media. The importance of the role of 
intracellular pH has been recognized in many diverse physiological and pathological 
processes including cell proliferation, apoptosis, fertilization, malignancy, multi-drug 
resistance, ion transport, lysosomal storage disorders and .Alzheimer's disease. (See Cell 

15 Physiol. Biochem. 2, 159 (1992); J. Biol. Chem. 270, 6235 (1995); Biophys. J. 68, 739 
(1995), J. Biol. Chem 270, 19599 (1995); Cancer Res, 54, 5670 (1994)). Fluorescent 
probes useful for assays of pH in the physiological range are available commercially (See 
Haugland R.P., Handbook of Fluorescent Probes and Research Chemicals 6" 1 Ed. Chap. 23). 

20 

EXAMPLES 

The invention described and claimed herein can be further appreciated by one 
skilled in the art through reference to the examples which follow. These examples are 
provided merely to illustrate several aspects of the invention and shall not be construed to 
25 limit the invention in any way. 

Transcription Factor Translocation 

Cells were grown in 96-well plates, fixed, incubated with Texas-Red-labeled 
antibody to the transcription factor protein, rinsed, and then stained with 5 p.M Hoechst 
30 33342 in buffer. 

The images were viewed at 0.5 x 0,5 mnr square with 1.08 x 1.08 unr 
pixelation Texas Red emission was excited at 568 nm and detected with a 600-nm long pass 
filter. Hoechst emission was excited at 364 nm and detected with a 420-480-nm bandpass 
filter Image acquisition time was 0 9 sec. There are -150 cells per image 
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An image of a field of cells which were not activated before fixing was taken. 
The Texas Red intensity in the nucleus is low compared to the cytoplasm. A composite of 
the images of the not-activated cells stained with Texas Red-labeled antibody and Hoechst 
33342 was generated. 

5 An image of a field of cells which were activated prior to fixing was taken. 

Due to color scaling, the cytoplasm is difficult to see without saturating the nucleus A 
composite of the images of the activated cells stained with Texas Red-labeled antibody and 
Hoechst 33342 was generated. 

The data analysis was performed according to the following method. A binary 

1 0 representation of the Hoechst image was generated by applying an appropriate threshold, 
those values greater than the threshold were set to one, those less than the threshold were set 
to zero. This served as the primary mask. Two daughter masks were then generated, one by 
eroding the primary mask, the other by dilating the primary mask and subtracting the original 
mask to form an annular mask. The Texas-Red-emission image was multiplied by the eroded 

15 binary mask, and the pixels summed as a measure of the quantity of labeled transcription 
factor in the nucleus. Similarly, the Texas-Red-emission image was multiplied by the annular 
binary mask, and the pixels summed as a measure of the quantity of labeled transcription 
factor in the cytoplasm. The degree of activation is assessed using the ratio of nuclear to 
cytoplasmic intensity. 

20 

Transient Ca Imaging of Muscarinic Receptor and Voltage-gated Channel Stimulation 

The cells in Figs. 1 9 and 20 were from a neuroblastoma line. They were 
grown and imaged in standard media. These cells express a muscarinic acetylcholine receptor 
that can be stimulated with Carbachol generating a large intra-cellular Ca release as a second 
25 signal. In addition the cells express a voltage-gated "L" Ca channel which can be stimulated 
by depolarizing the cell membrane with a large change in the external K~ concentration and 
which can be inhibited with Verapamil 

In general, the image sequences were initiated by rapidly adding 100 p,L of 
reagent in growth media to cells in 1 00 uL of growth media in a 96-well plate. The 
30 turbulence caused by the added volume generates a small distortion in cell shape. This 

distortion is visible as a transient alteration of the Ca fluorescence assigned to each cell in the 
first image frame after addition 

In Fig. 19 a movie with 1 2 seconds between frames is displayed The image 
sequence was initiated by the rapid addition of 100 pM Carbachol The final image is a 
35 binary mask, used to identify and enumerate fluorescent objects in the image, generated from 
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the pre-injection frame. Even though the pre-injection image appears dim, it is quite bright. 
The mask is applied to each image in the series, and for each object, the integrated intensity, 
normalized to the pre-injection image, is plotted vs. time, as displayed in Fig 25a. The mask 
was not processed for overlapping cells. For example, object 1 is likely more than one cell, 
5 but showed no response Object 7 may be 2 overlapping cells, with one showing a delayed 
response. 

Fig. 20a-h are selected frames of a movie showing the response of the 
neuroblastoma cells to a depolarization event initiated by the addition of 50 mM KG which 
opens the voltage-gated "L" channels. The analysis procedure was as is described above in 
1 0 connection to Fig. 25a. The results are displayed in Fig. 25b. Note the increased sensitivity 
obtained by using the "cell average" rather than the "image average". 

Live-cell G-Protein Coupled Receptor Binding 

The images displayed in Figs. 2 la-c to 22a-c were obtained on live cells in 96- 

1 5 well plates. The cells had been transfected with a G-protein coupled receptor, for which the 
natural peptide ligand is known. Prior to imaging, the cells were incubated with the native 
unlabeled ligand in normal growth media containing 10% serum for 20 minutes at 37°C, 
followed by 20 minutes with 20 nM fluorescein-labeled ligand and 100 nM LDS 751, also at 
37°C. Samples were not rinsed. 

20 These images are (0.5 x 0.5) mm 2 are with (1 .08 x 1 .08) u,nr pixelation. 

Fluorescein emission was excited at 488 rati and detected with a 45-nm bandpass filter 
centered at 535 nm. LDS 75 1 emission also excited at 488 nm and was detected with a 40- 
nm bandpass filter, centered at 690 nm Image acquisition time was 0.9 sec. These cells 
have -100,000 receptors/cell or about 25 receptors/urn 2 of membrane surface. 

25 Fig. 21a is an image of the cells after incubation with the labeled ligand. No 

wash step was preformed prior to imaging The substantial variation in reception activity is 
evident. Some cells bind so little ligand that they appear as depressions in the background. 
A cell-by-cell analysis of the binding activity is facilitated by making a mask from an image of 
LDS 75 1 emission, a non-specific nucleic acid stain, shown in Fig 21b. The staining is not 

30 entirely uniform, but the vast majority of cell volume is revealed. The overlay in Fig. 21c of 
the binary mask generated from thresholding the data in Fig. 21b with the receptor binding 
image yields a pseudo-color map of receptor activity. High activity is represented as yellow, 
while low activity is shown as orange-red. 

35 
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In Fig, 22 three images are displayed corresponding to points on the titration 
curve of the 20-nM labeled ligand with the unlabeled ligand. The curve is displayed in Fig. 
22a. A Kj = 3±1 x 10 10 M for the unlabeled ligand is calculated. 

Images illustrating receptor binding on a different mammalian cell line are 

5 shown in Fig. 23a-d. Fig. 23a is an image of the cells incubated with a 256 nM Cy3-labeled 
ligand. A range of binding activity is visible. Fig. 23b shows an overlay of the Cy3 data with 
a simultaneously acquired image of the 1-uM Hoechst 33342 stained nuclei. The latter 
serves as a reliable identifier of the individual cells. In Fig 23c, the image is of the cells 
incubated with 256 nM Cy3-labeled ligand in the presence of 10 uM unlabeled ligand, and in 

10 Fig. 23d, this data is displayed with the image of the 1 -uM Hoechst 33342 stained nuclei 
overlaid. The effect of displaced fluid by unlabeled cells is evident in Fig. 23 c. In the high 
correlation between Figs, 23c and d exemplifies the effectiveness of identifying cells by their 
excluded volume. 

15 Simulated Bead-Based Receptor-Binding 

In Fig. 24a-d images of Cy5-labeled silica beads are presented. The 
experiment is a simulation of a receptor-binding assay in which fluorescently-labeled ligands 
bind to membrane-bound receptors supported on microspheres. 

Silica microspheres, 4 p,m in diameter, were coated with polyethylenimine and 

20 biotinylated with a biotin NHS-ester. The activity of the beads was assayed with a 

fluorimeter by quantifying the amount of Cy5-labeled streptavidin removed from solution by 
adsorption onto a known quantity of beads. Each bead was found to hold 1.3 x 10 6 
streptavidin molecules. Beads were loaded with a known quantity of Cy5 molecules by pre- 
mixing an appropriate ratio of Cy5-labeled and non-labeled streptavidin and incubating with 

25 the beads. The loadings were equivalent to 0.16, 1 6 and 16 fmole/200 ]ig of polystyrene 
beads. Each bead had an average of 1 7, 1 70, or 1 700 labels, respectively. The samples were 
placed in Costar 96-well plates for imaging. Cy5 was excited with 647nm laser light and the 
emitted fluorescence was detected through a 40-nm bandpass filter centered at 690 nm. The 
scanned images were acquired at 1-um pixelation in approximately 0 7 seconds. 

30 Beads loaded with 1 70 and 1 700 molecules were readily detectable and the 17-fluor 

beads are discernable in images constituting Fig. 24. Beads loaded only with non-labeled 
streptavidin did not produce appreciable intensities. 
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What Is Claimed Is: 

1, A method for processing spatially defined data, each piece of the 
spatially defined data having a spatial definition and a value, the method comprising; 
storing an initial spatial definition; and 
for each spatial definition stored: 

retrieving the spatial definition, 

evaluating the value of a piece of the spatially defined data that 
is spatially related to the spatial definition retrieved, and 

storing the spatial definition for the piece of the spatially 
defined data evaluated if the value of the piece of the spatially defined data 
corresponds to the value of spatially defined data corresponding to the spatial 
definition retrieved. 



2. The method of claim 1, further comprising, for each spatial definition 
stored, designating as part of a group of pieces of the spatially defined data, each piece of the 
spatially defined data corresponding to each spatial definition stored. 

3. r The method of claim 1, further comprising, for each spatial definition 
stored, incrementing a count for each spatial definition stored. 

4. The method of claim 1, further comprising, for each spatial definition 
stored, comparing the spatial definition stored to a set of spatial definition limits to determine 
a set of limits for the spatial definitions stored. 

5. The method of claim 1, wherein the spatially defined data is a matrix 

of data. 



6. The method of claim 5, wherein the matrix of data is a bitmap. 



7. The method of claim 1, wherein the spatial definition is a set of 
coordinates for the piece of spatially defined data. 

8. The method of claim 1, wherein the spatially defined data is a bitmap 
and the value of each piece of spatially defined data corresponds to a bit value in the bitmap. 
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9. The method of claim 1, wherein the initial spatial definition is a spatial 
definition for a piece of spatially defined data identified as belonging to an object. 

10. The method of claim 1, wherein each spatial definition is stored in a 

stack. 

1 1 . The method of claim 1, wherein the evaluating the value of the piece 
of the spatially defined data comprises comparing the value of the piece of the spatially 
defined data to a value of spatially defined data corresponding to the spatial definition 
retrieved. 

12. The method of claim 1 , wherein the spatial definition of the piece of 
the spatially defined data that is spatially related to the spatial definition retrieved indicates 
that the spatial definition of the piece of spatially defined data is adjacent to the spatial 
definition retrieved. 

1 3 . The method of claim 1 , wherein the value of the piece of the spatially 
defined data corresponds to the value of spatially defined data corresponding to the spatial 
definition retrieved if each value is identical. 

14. The method of claim 1 , further comprising creating a copy of the 
spatially defined data, setting the value of spatially defined data corresponding to the spatial 
definition stored for each spatial definition stored, and performing a logical operation using 
each value of spatially defined data set and corresponding values of spatially defined data 
from the copy of the spatially defined data. 

1 5. The method of claim 14, wherein the logical operation is a logical 
EXCLUSIVE OR operation. 

1 6. The method of claim 1 , further comprising receiving the spatially 
defined data from a confocal imaging system comprising: 

a) a means for forming an elongated beam of electromagnetic radiation 
extending transverse to an optical axis along which the radiation 
propagates; 
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b) a means for directing and focusing the elongated beam onto a first 
elongated region in a first plane where an object is located and for 
directing electromagnetic radiation emitted from the object onto one 
or more second elongated regions, wherein each second elongated 
region is on a different second plane conjugate to the first plane; 

c) in at least one of the second conjugate planes, or in a third plane 
conjugate to at least one of the second conjugate planes, a detection 
device comprising a rectangular array of detection elements on which 
the electromagnetic radiation emitted from the object is coincident; 
and 

d) a means for scanning the object by moving the elongated beam relative 
to the object or by moving the object relative to the elongated beam 
such that the emitted electromagnetic radiation is delivered to the 
rectangular array of detection elements and is converted by the 
detection device into a plurality of electrical signals representative of 
the emitted electromagnetic radiation synchronously with said 
scanning. 



17. The method of claim 1, further comprising: 
identifying a current piece of spatially defined data; 
determining if any other pieces of spatially defined data that are 

adjacent to the current piece of spatially defined data are not part of a group that includes the 
current piece of spatially defined data; and 

separating the current piece of spatially defined data from the group if 
any of the other pieces of spatially defined data are not part of the group. 

1 8. The method of claim 17, wherein one of the other pieces of spatially 
defined data is determined as not being part of the group by determining that the value of the 
one of the other pieces of spatially defined data is different from the value of the current 
piece of spatially defined data. 

19. The method of claim 17, wherein the current piece of spatially defined 
data is separated from the group by setting the value of the current piece of spatially defined 
data. 
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20. The method of claim 17, wherein the determining and the separating 
are performed by performing a logical operation that sets the value of the current piece of 
spatially defined data based on the value of the current piece of spatially defined data and the 
value of at least one of the other pieces of spatially defined data. 

21. The method of claim 20, wherein the logical operation also 
substantially simultaneously sets the value of another piece of spatially defined data. 

22. The method of claim 1, further comprising: 
identifying a current piece of spatially defined data; 
determining if any other pieces of spatially defined data that are 

adjacent to the current piece of spatially defined data are part of a group that does not 
include the current piece of spatially defined data; and 

adding the current piece of spatially defined data to the group if any of 
the other pieces of spatially defined data are part of the group. 

23. The method of claim 22, wherein one of the other pieces of spatially 
defined data is determined as being part of the group by determining that the value of the one 
of the other pieces of spatially defined data is different from the value of the current piece of 
spatially defined data. 

24. The method of claim 22, wherein the current piece of spatially defined 
data is added to the group by setting the value of the current piece of spatially defined data. 

25. The method of claim 22, wherein the determining and the separating 
are performed by performing a logical operation that sets the value of the current piece of 
spatially defined data based on the value of the current piece of spatially defined data and the 
value of at least one of the other pieces of spatially defined data. 

26. The method of claim 25, wherein the logical operation also 
substantially simultaneously sets the value of another piece of spatially defined data. 
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